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ABSTRACT 


Today  there  are  over  110  million  mines  scattered  across  60  countries,  and  these 
mines  kill  or  injure  more  than  26,000  people  annually.  In  order  for  deminers  to  remove 
these  mines,  they  must  be  able  to  quickly  and  accurately  identify  them.  Existing  methods 
for  landmine  identification  involve  tedious  searching  through  reference  books. 

This  thesis  presents  an  expert  system  for  landmine  identification,  based  on  the  set 
of  thirty  Bosnian  mines  from  the  MineFacts  landmine  database.  The  user  is  queried  about 
the  landmine,  and  heuristics  are  applied  to  the  answers  which  are  then  used  to  calculate 
other  information  about  the  mine.  This  information  is  then  filtered  through  decision  trees 
to  generate  a  small  group  of  candidates  which  are  displayed  with  a  photo  and  confidence 
factor. 

The  system  was  modeled  and  tested  using  a  Microsoft  Excel  spreadsheet.  The 
system  can  narrow  candidates  to  within  two  choices  when  all  queries  are  correctly 
answered  and  to  within  three  candidates  when  70%  of  the  queries  are  correctly  answered. 
The  results  show  that  this  technique  has  potential  for  all  types  of  ordnance  identification. 
A  similar  system  could  be  implemented  to  cover  all  UXO  for  EOD  use  and  as  a 
reconnaissance  tool  by  non-EOD  trained  individuals. 
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1.  INTRODUCTION 


A.  OBJECTIVES 

The  objective  of  this  thesis  is  to  design  and  test  a  prototype  expert  system  to  assist 
deminers  and  Explosive  Ordnance  Disposal  (EOD)  technicians,  in  identifying  landmines. 
The  prototype  is  based  on  the  Bosnian  subset  of  landmines  from  the  MineFacts  database. 
A  successful  expert  system  will  assist  an  inexperienced  deminer  in  quickly  identifying  a 
landmine,  based  on  its  distinguishing  characteristics.  This  will  make  demining  safer  and 
more  efficient.  The  prototype  expert  system  has  direct  application  in  humanitarian 
demining  and  could  eventually  be  expanded  to  cover  all  landmines.  The  prototype  also 
demonstrates  that  an  expanded  system  could  be  useful  in  identifying  all  other  types  of 
unexploded  ordnance  (UXO).  Such  systems  would  make  valuable  expert  EOD 
knowledge  available  to  all  EOD  personnel  and  enhance  the  speed  and  accuracy  of 
identifying  ordnance. 

B.  BACKGROUND 

Landmines  have  become  a  serious  problem  in  the  world  today.  As  a  weapon  of 
war,  they  are  a  cheap,  effective  way  to  channel  the  enemy  and  protect  vulnerable  areas. 
Unfortunately,  landmines  are  rarely  removed  after  a  conflict  and  as  a  result,  there  are  now 
over  110  million  mines  scattered  across  60  countries  [UNIT  97].  Landmines  remain 
lethal  indefinitely,  and  over  26,000  people  are  injured  or  killed  annually  because  of  them 


1 


[TERR  94].  Because  of  this  problem,  the  new  field  of  humanitarian  demining  has 
emerged  to  clear  mines  from  former  battlefields,  thereby  making  them  safe,  habitable 
places  once  again. 

Planting  landmines  is  easy  -  removing  them  has  proven  to  be  a  much  more 
difficult  problem.  Over  700  types  of  landmines  are  used  in  the  world  today.  About  100 
new  types  have  been  developed  just  over  the  past  three  years  [UNIT  97].  Each  type  of 
mine  is  unique  and  may  have  one  of  many  different  types  of  firing  systems.  The  removal 
technique  for  one  mine  may  cause  another  type  of  mine  to  function,  so  before  any  mine 
can  be  safely  removed,  it  must  first  be  positively  identified.  For  this  reason,  computer 
based  training  programs  and  landmine  identification  systems  are  vital  in  assisting 
inexperienced  humanitarian  deminers.  Furthermore,  these  programs  can  help  make  up  for 
the  shortage  of  qualified  experts  by  extracting  years  of  EOD  knowledge  and  making  it 
widely  available. 

The  MineFacts  Database  is  one  type  of  landmine  identification  system  presently  in 
use.  It  was  developed  by  the  Humanitarian  Demining  Program  Office  of  the  U.S.  Army 
Night  Vision  Electro-Optical  Directorate  and  ESSEX  Corporation  [MINE  97]. 
MineFacts  has  been  fielded  to  Bosnia,  Cambodia,  and  other  nations  to  assist  humanitarian 
deminers.  The  current  interface  for  the  database  is  a  simple  query,  based  only  on  the 
mine’s  size,  shape,  country  of  manufacture,  and  casing.  During  the  selection  process,  no 
visual  assistance  is  given  to  the  user,  and  possible  matches  are  displayed  simply  as  a  list 
of  landmine  nomenclatures.  Depending  on  the  information  given,  this  list  could  vary 
from  a  few  landmines  to  hundreds.  An  expert  system  is  ideally  suited  for  improving  the 
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MineFacts  database.  It  could  be  used  to  select  a  group  of  landmine  candidates  based  on 
more  information,  narrowing  down  the  final  selection.  It  will  still  require  the  deminer  to 
make  the  final  identification,  but  it  could  present  pictures  of  possible  landmine  candidates 
for  the  selection.  Furthermore,  the  candidates  will  be  presented  to  the  user  with  a  level  of 
confidence  of  how  well  they  meet  the  attributes  specified  in  the  search.  It  can  provide  a 
faster,  more  efficient  search  method  with  more  varied  information  [QUIN  89]. 

C.  THESIS  QUESTIONS 

The  following  questions  are  addressed  in  this  thesis: 

•  Can  an  expert  system  be  useful  in  landmine  identification? 

Currently,  all  identification  is  based  on  the  deminer’s  knowledge  or  access  to 
publications.  Mines  are  examined  and  then  painstakingly  matched  to  pictures  in 
the  reference  books  for  identification.  This  is  a  very  time  consuming  process 
which  is  prone  to  errors. 

•  How  is  expert  landmine  knowledge  described?  How  is  the  knowledge  best 
extracted? 

Expert  knowledge  is  difficult  to  understand  and  model.  In  order  to  create  an 
expert  system,  an  examination  of  the  methods  used  by  experts  to  identify  a 
landmine  must  be  conducted.  Once  this  method  is  understood,  the  knowledge 
must  be  captured  and  displayed  in  a  format  useful  to  the  non-expert  user. 

•  What  methodology  is  best  suited  for  the  landmine  identification  problem? 
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This  problem  is  similar  to  other  identification  problems  but  it  has  some  unique 
points.  Unlike  other  items  to  be  identified,  the  landmine  cannot  always  be 
painstakingly  studied  and  examined.  Often,  the  information  gathered  on  the  mine 
will  be  missing  fields  or  will  be  an  approximation.  The  methodology  used  must 
take  this  uncertainty  into  account  when  presenting  a  solution. 

•  What  questions  and  sub-questions  are  best  to  implement  an  expert  system  that 
will  integrate  well  with  the  MineFacts  database? 

Questions  are  developed  from  the  fields  available  in  the  MineFacts  database. 
These  questions  are  based  on  an  EOD  technician’s  landmine  reconnaissance 
technique.  Each  question  must  be  logically  examined  to  determine  how  it  may  be 
affected  by  situations  that  are  unique  to  landmine  warfare. 

•  What  are  possible  applications  for  similar  expert  systems  that  could  be 
applied  to  other  EOD  databases? 

There  is  currently  no  decision  support  tool  available  for  EOD  Technicians. 
Application  of  an  expert  system  to  the  other  EOD  databases  could  improve 
accuracy  and  speed  of  UXO  identification.  There  are  over  5,000  items  currently 
in  the  EOD  publications  set,  and  a  mistaken  ordnance  identification  could  be  fatal 
for  the  EOD  technician. 

D.  ORGANIZATION  OF  THE  STUDY 

This  thesis  presents  the  use  of  a  prototype  expert  system  for  ordnance 
identification. 
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•  Chapter  n  provides  background  information  regarding  landmine  warfare  and 
expert  systems.  Background  is  also  given  on  landmine  clearance  and 
unexploded  ordnance  clearance.  Finally,  an  explanation  is  provided  of  the 
MineFacts  database  and  the  60-series  EOD  database. 

•  Chapter  in  presents  the  methodology  used  in  the  implementation  of  the  expert 
system.  Each  field  of  the  MineFacts  database  will  be  examined  and 
appropriate  metrics  and  questions  will  be  proposed.  An  evaluation  of  each 
question  will  also  be  given,  focusing  on  the  logic  used  to  generate  the 
question. 

•  Chapter  IV  presents  the  implementation  of  the  prototype  expert  system. 
Analysis  of  the  efficiency  of  the  prototype  will  be  discussed.  This  chapter  also 
covers  the  user  interface  and  hardware  requirements. 

•  Chapter  V  gives  a  summary  of  the  thesis,  the  expert  system  design  and  the 
working  prototype.  Also,  recommendations  are  given  for  future  study  based 
on  the  conclusions  drawn  from  the  prototype.  Finally,  recommendations  are 
given  for  expanded  use  of  this  technology  in  EOD  operations. 
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II.  BACKGROUND 


A.  LANDMINE  WARFARE 

1.  History  of  Landmines 

Modem  landmines  first  gained  popular  use  in  World  War  I  as  the  German 
response  to  the  new  British  tank.  The  term  “mine”  comes  from  the  earlier  practice  of 
tunneling  under  an  enemy’s  fortifications  and  placing  explosives  to  breach  their  defenses. 
Early  landmines  were  simply  artilleiy  shells  with  contact  fuzes.  These  shells  were  buried 
fuze  up  in  the  hope  that  enemy  tanks  would  be  stopped  during  an  assault  [SLOA  86]. 

Landmines  became  more  widely  used  in  World  War  n.  In  some  cases  minefields 
were  laid  miles  wide  in  an  attempt  to  stop  enemy  armor.  World  War  n  also  saw  the  rise 
of  antipersonnel  mines.  These  mines  were  initially  developed  to  protect  antitank 
minefields,  but  were  later  used  specifically  against  the  infantry  soldier  [SLOA  86].  As 
mine  clearance  techniques  improved,  so  did  techniques  to  prevent  their  removal.  Anti-lift 
and  anti-handling  devices  were  developed.  Fuze  functioning,  which  had  previously  been 
limited  to  pressure  actuation,  expanded  to  include  pressure  release,  tripwire  and 
command  detonation.  In  addition  to  new  actuation  techniques,  mine  construction  was 
improved  with  the  use  of  non-metallic  materials  such  as  plastic  and  bakelite  to  make 
mine  location  more  difficult  [STOP  72]. 

The  last  50  years  has  seen  the  largest  growth  in  landmine  technology.  Mass 
production  has  made  them  cheap  and  reliable.  Construction  materials  have  improved. 
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and  completely  non-metallic  mines  are  in  use  in  many  areas.  Fuzing  technology  has 
advanced  to  include  magnetic  influence,  seismic  influence,  anti-disturbance  and  selective 
targeting  [HIDD  94].  Scatterable  mines  now  allow  placement  to  be  done  mechanically  or 
by  artillery,  increasing  the  number  of  mines  deployed  and  making  tracking  them  nearly 
impossible.  These  new  advances  have  made  modem  mines  prolific,  harder  to  detect  and 
more  deadly. 


2.  ClassiHcation  of  Landmines 

There  is  a  great  deal  of  variety  amongst  modem  landmines.  Each  country 
produces  their  own  designs  and  there  are  over  700  unique  landmines  in  use  in  the  world 
today  [MINE  97].  This  number  does  not  take  into  account  outdated  mines  already  in  the 
ground  which  are  no  longer  used  but  still  present  a  hazard.  Mines  may  be  classified  in 
several  ways.  The  most  common  classification  is  by  intended  target:  antitank  or 
antipersonnel.  These  two  major  groups  are  further  sub-divided  into  more  specific 
categories  such  as  anti-vehicular,  multi-use,  alarm,  and  illumination.  Within  the  two 
major  groups  mines  can  be  classified  by  size,  country  of  use  or  manufacture,  effect, 
method  of  emplacement,  and  method  of  actuation. 

Antipersonnel  mines  are  usually  small  in  size  and  come  in  a  variety  of  shapes 
(Figure  2.1).  These  mines  are  intended  to  cause  personnel  casualties  by  means  of 
fragmentation  or  blast.  They  can  be  either  buried  or  surface  laid,  and  the  newest  mines 
can  be  scattered  by  machine,  artillery,  or  aircraft.  Depending  on  their  size  and  design. 
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antipersonnel  mines  can  produce  casualties  up  to  100  meters  away.  Antipersonnel  mines 
may  be  actuated  by  pressure,  trip  wire,  magnetic  influence  or  command  detonation. 
Antipersonnel  mines  are  usually  smaller  than  six  inches  in  size  and  rarely  contain  more 
than  one  kilogram  of  explosive. 

Fragmentation  mines  come  in  three  varieties:  omni-directional,  directional,  and 
bounding  fragmentation.  Injuries  from  omni-directional  fragmentation  mines  are  caused 
by  shrapnel  from  the  mine  case.  The  mines  can  be  buried  or  surface  laid  but  the  are  often 
mounted  on  a  stake  above  the  ground  to  increase  their  killing  radius.  Directional 
fragmentation  mines  are  designed  to  control  the  direction  of  the  fragmentation.  This  is 
normally  accomplished  by  embedding  steel  balls  into  one  side  of  a  block  of  explosive. 
Bounding  fragmentation  mines  are  considered  the  most  menacing  of  all  fragmentation 
mines.  They  are  buried  below  the  ground  and  function  when  a  tripwire  or  pressure  fuze  is 
tripped.  When  this  occurs,  a  small  explosive  charge  launches  a  fragmentation  projectile 
into  the  air.  This  projectile  detonates  around  one  meter  off  the  ground  maximizing  the 
fragmentation  radius  of  the  mine  and  causing  traumatic  upper  body  injuries. 

All  of  the  early  antipersonnel  mines  were  fragmentation  mines,  but  many  new 
mines  are  now  blast  only.  Blast  mines  cause  casualties  by  the  explosive  force  of  the 
mine’s  detonation.  They  are  almost  exclusively  pressure  actuated,  as  this  assures  the 
victim  is  in  close  proximity  to  the  explosion.  Blast  antipersonnel  mines  are  generally 
produced  in  40  gram  and  200  gram  explosive  weights.  The  smaller  mines  are  meant  to 
blow  off  a  foot,  while  the  larger  mines  can  cause  amputation  of  the  entire  leg  or  even 
death. 
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Figure  2.1  Yugoslav  PMA-3  Antipersonnel  Mine 
This  is  a  pressure  actuated,  blast  antipersonnel  mine.  It  is  constructed  of  plastic  and 
rubber  and  contains  34.5  grams  of  explosive.  The  photo  shows  a  deminer  removing  the 

fuze  [MINE  97]. 

Antitank  mines  are  always  larger  than  antipersonnel  mines.  They  are  also  most 
often  pressure  actuated,  but  may  be  set  off  by  magnetic  influence,  tilt-rod,  command 
detonation,  seismic  influence  or  even  infrared  [MINE  97]  [SLOA  86]  [UNEX  94].  These 
mines  are  normally  fuzed  to  prevent  actuation  by  an  individual  soldier,  but  they  are 
normally  protected  with  antipersonnel  mine  or  anti-removal  devices.  Antitank  mines  are 
five  inches  or  larger,  with  most  being  a  foot  or  more  across.  They  can  be  buried,  surface 
laid,  or  scattered  by  artillery,  machinery,  or  aircraft. 

There  are  several  varieties  of  antitank  mines:  blast,  shaped-charge,  or  Miznay- 
Schardin.  Blast  type  mines  often  contain  more  than  ten  kilograms  of  explosive  and  are 
designed  to  damage  a  tank  or  destroy  a  light  vehicle.  Shaped-charge  mines  attempt  to 
pierce  the  hull  of  a  tank  using  an  explosively  formed  jet  of  gas  and  molten  metal.  They 


can  penetrate  armor  several  inches  thick,  and  are  sometimes  used  to  attack  vehicles  from 
the  side.  These  mines  are  emplaced  next  to  a  road,  horizontally  with  the  ground.  A 
passing  vehicle  trips  the  mine  and  the  shaped-charge  fires  into  the  side  or  rear  or  the 
vehicle.  Miznay-Schardin  mines  are  “belly  attack  mines,”  so  called  because  when 
tripped,  they  throw  a  curved  steel  plate  into  the  “belly”  of  the  tank.  This  plate  strikes  the 
hull  with  such  force  that  metal  spalling  occurs  on  the  inside  surface  of  the  hull.  These 
metal  fragments  kill  the  crew  inside  the  vehicle. 


Figure  2.2  Former  Soviet  TM-62M  Antitank  mine 
This  mine  is  a  metal  cased,  antitank  blast  mine.  The  TM-62  was  the  mainstay  of  the 
Soviet  antitank  mine  inventory.  It  accepts  a  variety  of  fuzes  and  comes  in  four  different 

models  [MINE  97]. 

There  are  a  few  other  ways  that  mines  can  be  classified.  The  way  a  mine  is 
emplaced  is  sometimes  used  to  classify  mines.  Some  classifications  are  scatterable, 
manually  emplaced,  buried,  stake,  or  surface  laid.  Mines  manufactured  by  one  country 
often  have  similar  features  and  are  sometimes  referred  to  as  a  “family”  of  mines.  Mines 
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that  belong  to  a  family  may  have  completely  different  firing  systems  from  each  other  and 
due  to  their  similar  outer  construction  can  sometimes  be  very  difficult  to  tell  apart  [SAPP 
90].  Some  mines  can  also  be  recognized  by  non-standard  design  features  such  as  an 
unusual  shape  (Figure  2.3)  or  the  use  of  an  unusual  case  material,  such  as  concrete. 


Figure  2.3  Former  Soviet  Union  PFM  Antipersonnel  mine  (shown  to  scale) 

This  scatterable  mine  is  also  known  as  a  butterfly  mine  and  is  often  picked  up  by 
children.  It  is  usually  employed  in  clusters  ranging  from  1,000  to  6,000  mines  and  can  be 
delivered  by  helicopters  or  high-performance  aircraft  [MINE  97]  [UNIT  96]. 

3.  Future  Trends  in  Land  Mine  Technology 

As  the  technology  used  to  locate  and  disarm  landmines  improves,  so  will 
technology  to  avoid  detection  and  location.  Recent  years  have  seen  a  large  growth  in 
plastic  mines  and  this  has  all  but  eliminated  the  effectiveness  of  magnetometers  for 
detection.  Future  mines  will  attempt  to  avoid  detection  by  incorporating  a  shielding 
scheme  against  high-energy  detectors  or  will  be  sealed  to  avoid  chemical  detection  by  a 
sniffer.  Mines  may  also  have  new  firing  systems  that  will  detonate  when  they  sense  an 
active  detection  system,  such  as  a  magnetometer  or  high  energy  detector.  New  firing 
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systems  incorporating  microchips  will  allow  mines  to  identify  friend  or  foe  and  select 
targets  of  higher  value  such  as  communications  vehicles. 

Politically,  landmines  are  losing  their  appeal  as  acceptable  weapons.  There  is  a 
move  to  ban  the  use  and  production  of  landmines,  and  the  U.S.  has  joined  in  the 
international  moratorium  on  their  use.  This  moratorium  does  not  include  the  new  “smart 
mines”,  which  are  designed  to  self-destruct  some  time  after  they  are  deployed.  While 
self-destruction  will  remove  a  large  number  of  mines,  5-10%  of  the  mines  are  likely  not 
function  as  designed  and  will  remain  live  in  the  minefield  [TERR  94].  Even  if  the 
moratorium  is  accepted  worldwide,  there  are  still  over  110  million  mines  that  must  be 
removed  from  existing  minefields  [TERR  94]. 

4.  Landmine  Clearance 

Once  a  landmine  is  in  the  ground,  it  takes  a  tremendous  amount  of  effort  to 
remove  it.  It  is  estimated  that  it  costs  three  dollars  to  produce  a  mine  and  one-thousand 
dollars  to  remove  it  once  it  is  in  the  ground  [TERR  94].  These  costs  are  a  result  of  the 
difficulty  and  danger  involved  in  landmine  clearance.  There  are  basically  two  approaches 
to  landmine  clearance:  the  tactical  military  method  and  the  humanitarian  method. 

a.  Military  Mine  Clearance 

Landmines  are  a  nuisance  to  military  forces.  As  a  weapon,  they  are  only 
effective  in  channeling  the  enemy’s  maneuver  or  harassing  groimd  troops.  When  a 
military  force  encounters  a  minefield,  they  will  either  change  direction  to  bypass  the 
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obstacle,  or  attempt  to  breach  the  minefield  to  continue  their  advance.  Breaching  will  be 
accomplished  with  mine  rollers  or  some  other  mechanized  method  if  possible,  or 
explosively  with  a  mine  clearing  charge  such  as  a  Mine  Clearing  Line  Charge  (MICLIC). 
Mines  are  only  removed  by  hand  when  these  other  options  are  not  feasible,  or  for  lone 
mines.  When  hand  removal  is  used,  the  deminers  will  remove  the  minimum  number  of 
mines  necessary  to  allow  the  mission  to  continue  [SAPP  90]. 

b.  Humanitarian  Demining 

Humanitarian  demining  is  a  relatively  new  concept.  It  has  come  about  as  a 
result  of  the  proliferation  of  landmines  in  small  regional  and  civil  conflicts.  Because  the 
mines  are  very  cheap,  they  have  gained  wide  use  in  third  world  in  countries,  which  are 
not  equipped  to  remove  them  after  a  conflict  ends.  Countries  like  Cambodia, 
Afghanistan,  Iraq  and  Somalia  are  a  sampling  of  the  60  countries  where  mines  have  been 
used  in  recent  years  [UNIT  96].  Humanitarian  demining  came  about  to  remove  those 
mines  and  make  the  land  habitable  again. 

The  first  principle  of  humanitarian  demining  is  that  one  hundred  percent  of 
the  mines  must  be  removed.  This  differs  from  military  mine  clearance  in  strategy, 
methodology  and  goal.  Each  mine  must  be  located,  identified  and  rendered  safe.  Unlike 
military  mine  clearance,  deminers  must  avoid  detonating  any  landmines  as  this  will 
contaminate  the  minefield  with  shrapnel  and  undetonated  explosive  and  hinder  future 
searches  with  magnetometers  or  explosive  sniffers.  For  this  reason  meticulous  care  is 
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taken  to  find  every  mine,  properly  identify  it  and  then  remove  it  for  destruction  elsewhere 
[TERR  94]. 

Humanitarian  mine  clearance  also  differs  from  military  mine  clearance  in 
the  level  of  expertise  of  its  technicians.  Humanitarian  deminers  are  often  local  people 
who  have  been  trained  to  remove  the  mines.  They  are  often  inexperienced  and,  unlike 
military  EOD  personnel,  have  little  reference  material  to  assist  them. 

c.  Unexploded  Ordnance  Clearance 

UXO  clearance  is  often  confused  with  mine  clearance.  While  it  is  similar 
in  many  aspects,  it  is  fundamentally  different  in  location,  identification  and  methods  of 
disarming.  A  UXO  is  a  dangerous,  uncontrollable  piece  of  ordnance  that  failed  to 
function  as  it  was  designed.  This  type  of  clearance  takes  place  on  the  battlefield  and  also 
on  former  firing  ranges  here  in  the  United  States.  UXO’s  are  usually  found  on  the  surface 
which  makes  them  easier  to  locate  than  landmines.  However,  UXO  identification  is 
much  more  difficult  than  for  landmines  due  to  the  huge  variety  of  ordnance  in  use  in  the 
world  [TERR  94].  Once  identified,  the  neutralization  of  the  item  is  often  complicated  by 
the  unstable  condition  of  the  ordnance. 

In  the  past  few  years,  the  U.S.  military  has  closed  many  installations  in  the 
U.S.  and  overseas.  These  bases  often  had  firing  ranges  and  impact  areas  which  contain 
huge  numbers  of  unexploded  ordnance.  Clean-up  operations  on  these  installations  have 
some  characteristics  from  both  military  mine  clearance  and  humanitarian  demining. 
These  operations  work  to  achieve  100%  clearance,  but  are  not  limited  in  detection 
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methods  or  in  methods  of  disposal.  Because  UXO’s  are  generally  metal  cased,  they  are 
easily  located,  and  once  identified  are  often  relatively  safe  to  move  to  a  disposal  area.  For 
this  reason,  this  type  of  ordnance  contamination  problem  may  benefit  from  a  similar 
expert  system  approach  as  the  one  described  here  for  landmine  identification. 

B.  EXPERT  SYSTEMS  AND  DATABASES  USED  FOR  OBJECT 
IDENTIFICATION 

1.  Expert  Systems 

Ever  since  computers  were  invented  man  has  tried  to  make  the  machine  think  like 
a  human.  An  expert  system  attempts  to  use  human  knowledge  to  solve  a  problem  that  has 
traditionally  required  human  intelligence  to  be  solved.  More  specifically,  an  expert 
system  is,  “a  computer-based  system  that  performs  at  the  level  of  an  expert  in  some 
specialized  domain  using  domain  specific  knowledge  (usually  acquired  from  experts)” 
[BHAR  96].  This  domain  specific  expert  knowledge  is  represented  by  heuristics  or  “rules 
of  thumb”  within  the  computer.  This  differs  from  the  ordinary  algorithmic  computing 
method  where  the  computer  has  very  little  knowledge  and  solves  tasks  based  only  on  a 
basic  algorithm  and  set  boundaries  for  the  problem.  An  expert  system  contains  a  large 
knowledge  base,  uses  symbolic  logic  rather  than  an  algorithm,  and  applies  knowledge 
appropriate  to  the  problem  to  reach  a  conclusion.  These  attributes  allow  the  program  to 
solve  a  vast  array  of  problems  within  its  domain  of  knowledge.  An  algorithmic  program 
may  have  to  be  reprogrammed  for  each  new  problem,  because  the  algorithm  and 
knowledge  used  to  solve  the  problem  are  integral  to  the  program’s  design  [WTDM  96]. 
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Humans  solve  problems  in  a  very  different  way  from  a  computer.  The  human 
mind  integrates  bits  of  knowledge  retrieved  from  a  large  collection  of  experience  to  solve 
a  problem.  If  a  problem  is  too  large,  the  human  expert  will  break  the  problem  into 
smaller  parts.  The  expert  system  attempts  to  mimic  this  process  -  rules  are  used  to 
represent  those  small  fragments  of  human  knowledge  and  a  database  is  substituted  for  a 
range  of  experience.  Problems  are  broken  down  into  manageable  parts,  which  are  applied 
to  the  knowledge  base.  This  allows  even  unfamiliar  problems  to  be  solved,  if  the  rules  in 
the  knowledge  base  are  sufficient  to  create  a  path  to  a  solution.  One  advantage  of  an 
expert  system  over  a  human  expert  is  that  the  program  can  explain  explicitly  how  it 
arrived  at  a  conclusion  and  give  a  level  of  confidence  for  the  answer  [PCAI  97]  [WIDM 
96]. 


Figure  2.4  Shows  the  components  in  an  expert  system  and  their  interaction  [WIDM  96]. 

An  expert  system  is  usually  composed  of  a  user  interface,  an  inference  engine,  a 
standard  database,  and  a  knowledge  base  (Figure  2.4).  The  knowledge  base  consists  of  a 
series  of  heuristics,  in  a  IF-THEN  format.  The  user  interacts  with  the  user  interface  to 
input  the  information  the  expert  system  requires.  This  information  is  passed  to  the 
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inference  engine  which  integrates  the  data  provided  by  the  user  with  expert  knowledge 
from  the  knowledge  base  and  with  data  specific  to  the  problem  from  the  database.  The 
inference  engine  then  attempts  to  use  all  this  data  to  make  sub-conclusions  and 
conclusions  about  the  problem  [PCAI 97]  [WBDM  96]. 

One  very  common  part  of  most  expert  systems  is  the  explanation  subsystem.  This 
feature  allows  the  user  to  query  the  system  about  conclusions  it  has  made  and  trace  back 
through  the  reasoning  used  to  arrive  at  that  conclusion.  Because  expert  systems  represent 
human  knowledge  in  formal  rules,  the  explanations  of  reasoning  used  to  reach  a 
conclusion  are  produced  in  the  same  natural  language  format  in  which  the  rules  are 
written  [PCAI  97]  [WIDM  96]. 

Expert  systems  are  used  for  a  variety  of  tasks  including  diagnostics,  data 
interpretation,  object  classification,  and  construction  [BHAR  96].  They  can  be  applied  to 
these  problems  in  two  ways.  In  a  decision  support  role,  they  can  be  used  to  remind  an 
expert  of  options  that  can  be  considered  or  information  that  may  have  been  overlooked. 
This  use  is  most  commonly  seen  in  medical  expert  systems.  The  second  way  an  expert 
system  can  be  applied  is  as  a  decision  maker,  to  allow  a  person  with  little  knowledge  to 
make  a  decision  above  their  level  of  experience.  This  application  is  most  often  used  in 
manufacturing  and  industry  [WIDM  96]. 

An  example  of  a  medical  expert  system  is  MYCIN,  an  expert  system  that  was 
designed  to  diagnosis  meningitis  and  blood  infections  and  then  recommend  treatment. 
MYCIN  was  developed  in  the  early  1970's  by  Dr.  Edward  Shortliffe  at  Stanford 
University,  and  though  it  never  gained  wide  clinical  use,  it  did  serve  as  a  template  for 
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future  diagnosis  systems  that  are  in  use.  Its  major  impact  on  expert  system  programming 
was  its  ability  to  clearly  explain  its  conclusions.  [WIDM  96]  [FORT  89]  [HART  86] 
[SLAT  87] 

MYCIN  used  about  400  heuristic  rules  to  reach  a  conclusion.  These  rules  were 
written  in  an  “IF-THEN”  type  structure  [SLAT  87].  These  heuristics  were  probabilistic 
in  nature.  This  allowed  MYCIN  to  make  some  diagnoses  with  uncertain  information, 
based  on  some  “certainty  factor”  [FORT  89].  MYCIN  was  able  to  explain  its  diagnosis, 
by  tracing  back  through  its  rules  and  giving  the  user  its  reasoning  from  each  rule. 

Expert  systems  have  gained  wide  use  in  other  areas.  One  example  is  the  system 
used  by  credit  card  companies  to  check  credit  transactions.  The  system  rapidly  makes  a 
decision  whether  to  extend  approval  for  credit  whenever  the  credit  card  is  used  by  the 
customer.  Other  popular  uses  include  grammar  checkers  in  word  processing  programs 
and  “wizards”  in  popular  software  packages.  [WIDM  96] 

Expert  Systems  do  have  some  drawbacks.  The  knowledge  base  is  restricted  and 
there  may  be  an  instance  where  the  question  is  beyond  the  systems  domain  of  knowledge. 
Problems  outside  the  knowledge  base  cannot  be  solved  without  adding  to  the  knowledge 
base.  Also,  if  the  rules  for  the  expert  system  are  not  correctly  entered,  there  is  the  risk 
that  some  conclusions  may  be  wrong.  This  should  be  identified  in  testing,  but  if  the  error 
is  small,  it  may  be  missed.  The  system  would  treat  this  rule  as  correct  and  make 
explanations  based  on  this  rule  since  it  has  no  way  of  determining  if  the  rule  is  in  fact 
correct.  [BENE  89] 
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2.  Current  Expert  Systems  for  Ordnance  Identification 


There  are  currently  no  expert  systems  in  use  for  ordnance  identification.  The 
EOD  field  has  only  recently  seen  the  use  of  automation  with  the  arrival  of  CD-ROM 
references  in  1994.  These  electronic  references  are  discussed  below. 

3.  Explosive  Ordnance  Disposal  Databases 

The  U.S.  military  has  developed  several  ordnance  databases  for  EOD.  The  most 
important  is  the  60-series  publication  used  by  all  branches  of  the  U.S.  Military.  This  joint 
service  series  of  publications  is  used  by  EOD  technicians  to  identify  over  5000  types  of 
ordnance  and  contain  specific  information  on  how  to  render  each  of  these  items  safe. 

The  60-series  has  recently  been  placed  on  CD-ROM,  but  previous  versions  were 
on  paper  and  microfiche  format.  Both  the  paper  and  CD-ROM  sets  consist  of  an 
Identification  Guide  and  a  collection  of  individual  publications  for  each  piece  of 
ordnance.  The  Identification  Guide  contains  line  drawings  of  ordnance  ordered  by  size, 
and  is  used  as  an  index  to  find  the  correct  publication  for  an  unknown  item.  To  make  an 
identification,  the  EOD  technician  makes  a  close  measurement  of  the  unknown  item.  The 
technician  must  then  make  a  subjective  judgment  about  what  kind  of  ordnance  the  item  is 
(bomb,  projectile,  submunition,  landmine,  etc.).  Then  the  Identification  Guide  for  that 
type  of  ordnance  is  selected  and  the  pictures  in  the  guide  are  compared  to  a  drawing  made 
by  the  technician  during  his  reconnaissance.  Once  the  unknown  item  is  matched,  the 
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Identification  Guide  will  list  the  60-series  location  where  the  render-safe  procedures  and 
other  detailed  information  on  the  ordnance  can  be  found. 

This  60-series  identification  method  does  present  some  problems  when 
information  is  incomplete  or  incorrect.  If  the  EOD  technician  fails  to  properly  identify 
the  type  of  the  item  (e.g.  he  calls  a  landmine  a  submunition),  then  he  will  be  looking  for 
the  unknown  item  in  the  wrong  book.  Also,  since  many  types  of  ordnance  are  similar  in 
size,  a  large  number  of  items  must  be  screened  to  find  the  correct  item.  Moreover,  if  the 
technician  is  unable  to  get  a  measurement,  the  entire  guide  must  be  searched  to  find  a 
match  to  the  picture. 

The  method  for  locating  an  item  on  the  60-series  CD-ROM  has  not  changed  from 
the  paper  and  microfiche  version,  and  the  process  still  requires  tedious  searching  to  make 
an  identification.  Ordnance  is  still  searched  by  type  and  size,  using  an  automated 
Identification  Guide.  The  CD-ROM  is  much  faster,  but  because  it  uses  the  same  methods 
as  the  paper  system,  its  efficiency  is  not  greatly  improved. 

C.  THE  MINEFACTS  DATABASE 

MineFacts  is  a  CD-ROM  based  database  that  contains  information  on  all 
landmines  that  are  in  use  in  the  world  today.  It  was  designed  specifically  as  a  tool  to 
assist  in  landmine  identification  by  humanitarian  deminers.  MineFacts  was  developed  by 
Essex  Corporation  under  contract  to  the  U.S.  Army  Night  Vision  and  Electronic  Sensors 
Directorate  and  the  U.S.  Navy  Office  of  Special  Technology  [MINE  97].  It  has  been 
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distributed  to  Bosnia,  Angola,  Croatia,  Cambodia  and  other  countries  where  humanitarian 
demining  activities  are  being  conducted. 

The  MineFacts  database  is  a  way  to  provide  vital  information  to  humanitarian 
deminers.  The  procedures  for  identifying  and  disarming  ordnance  have  always  been 
closely  guarded  secrets,  and  historically,  humanitarian  deminers  have  no  references  to 
assist  them.  The  U.S.  government  commissioned  the  MineFacts  database  as  a  way  to  aid 
and  encourage  demining.  While  the  database  does  not  contain  secret  information,  it  does 
contain  useful  data  on  each  mine  and  neutralization  methods  for  most  mines. 
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Figure  2.5  MineFacts  Search  Screen  [MINE  97]. 

The  database  is  programmed  in  Microsoft  FoxPro  and  has  a  user  interface  that 
allows  mines  to  be  sezu-ched  by  name  or  characteristics.  The  user  may  only  search  six 
fields:  mine  type,  shape,  case  material,  general  size,  county  of  use  or  the  country  of 
manufacture  (figure  2.5).  The  selections  are  limited  and  do  not  cover  the  variation  found 
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in  the  actual  mine  set.  Mines  which  do  not  fit  in  the  given  options  must  be  listed  as 


unknown. 


Entange 


Flag 
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Figure  2.6  MineFacts  Description  Results  Screen  [MINE  97]. 


Once  the  available  information  has  been  entered,  MineFacts  will  report  the 
number  of  mines  found  and  allow  the  user  to  look  at  this  list,  one  mine  at  a  time  (Figure 
2.6).  Each  page  shows  a  photo  of  the  mine,  nomenclature,  general  description,  and 
country(s)  of  use  and  manufacture.  More  detailed  information  on  each  mine  is  available 


on  eight  supplementary  pages  (Figure  2.7). 

Because  many  mines  follow  the  same  basic  design,  searches  based  on  these  few 
parameters  can  produce  very  large  lists,  and  paging  to  find  the  correct  mine  can  be 
tedious  and  time  consuming.  As  an  example.  Figures  2.5  -  2.7  show  the  results  of  a 
search  for  a  cylindrical,  plastic,  antitank  mine  under  six  inches  in  diameter.  This  search 
produced  109  mines,  requiring  the  user  to  page  through  the  mines  until  a  photo  match 
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Figure  2.7  MineFacts  Detailed  Mine  Information  Screen  [MINE  97] 


Case  Material 

.  Plastic  '''^v  . 

Case  Color 

OD  green,  eencl,  or  other 

custom  color  x 

No.  or  Fuze  Wells 

was  found.  This  search  method  produces  even  less  useful  results  when  the  user  cannot 
answer  one  or  more  of  the  search  questions. 

This  is  where  an  expert  system  could  be  applied.  It  is  obvious  that  the  user 
interface  is  limited  on  the  MineFacts  database  but  adding  more  options  to  the  query 
would  not  fully  solve  the  problem.  Users  may  still  have  incomplete  information,  or  the 
data  may  not  be  accurate.  An  expert  system  can  aid  the  user  in  making  a  positive 
identification  with  this  data,  and  give  the  user  some  level  of  confidence  for  its 
recommendations.  The  system  can  also  explain  how  it  arrived  at  its  decision,  allowing 
the  user  to  modify  the  search  as  necessary.  Chapter  DI  discusses  the  methodology  used  to 
construct  an  expert  system  for  the  MineFacts  database. 
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m.  METHODOLOGY 


A.  APPROACH 

The  intention  of  this  thesis  was  to  develop  an  intelligent  associate  to  assist 
deminers  in  landmine  classification.  This  identification  is  based  on  information  gathered 
by  the  deminer  and  input  into  the  system.  To  develop  this  system,  the  author  first  looked 
at  the  logic  required  to  produce  the  desired  outcome  and  then  determined  a  plan  for 
system  development.  This  chapter  will  discuss  the  knowledge  base,  knowledge 
acquisition,  and  the  methods  used  to  develop  the  inference  engine. 

1.  Selection  of  a  Method 

There  are  many  different  methods  that  could  be  used  to  create  a  system  for  object 
identification.  The  author’s  intention  was  to  follow  as  closely  as  possible  the  approach 
that  EOD  technicians  currently  use,  while  maximizing  the  use  of  all  available 
information.  This  required  querying  the  user  on  as  many  fields  as  the  database  allowed 
and  make  inferences  based  on  the  data  provided  by  the  user.  This  inferred  data  along 
with  the  user  supplied  data,  would  then  be  used  to  derive  the  identification  of  the  mine. 

2.  Selection  of  Data  -  Landmine  Set 

The  first  task  in  this  project  was  to  select  a  landmine  set  to  use  with  the  prototype. 
The  landmine  set  is  used  to  give  a  defined  starting  point  for  an  expert  to  examine  the  data. 
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The  MineFacts  database  contains  700  landmines  which  is  too  large  a  number  to  manage, 
so  the  prototype  was  limited  to  the  thirty  mines  in  the  Bosnian  mine  subset.  Several 
versions  of  the  MineFacts  database  have  been  used  by  humanitarian  deminers  in  Bosnia 
for  three  years,  affirming  that  the  information  on  these  mines  is  current  and  correct. 
Although  this  subset  lacks  some  of  the  more  unusual  mines,  it  does  include  a  fairly  broad 
variety  of  antitank  and  antipersonnel  mines  and  is  a  fair  representation  of  the  entire 
database.  Inclusion  of  rare  mines  would  require  greatly  expanding  the  landmine  set  and 
is  not  practical  at  this  time. 

3.  Examination  of  the  Landmine  Database  Fields 

Once  the  landmine  set  was  identified,  the  author  began  a  detailed  examination  of 
the  tables  and  fields  in  the  MineFacts  database.  All  relevant  data  in  MineFacts  is  carried 
in  two  separate  tables,  the  ENGLRMKS  table  and  the  ENGLDATA  table.  These  tables 
are  indexed  with  the  field  MINEID  and  are  used  to  search  for  and  then  display 
information  and  photographs  associated  with  each  mine.  The  ENGLRMKS  table 
contains  all  landmine  data  with  the  exception  of  the  fields  listing  the  photos  for  each 
landmine.  The  ENGLDATA  table  only  contains  a  few  information  fields  and  is  the  table 
that  the  database  currently  uses  for  mine  queries.  The  more  complete  ENGLRMKS  table 
was  used  for  the  structuring  of  questions  and  searching.  The  ENGLRMKS  table  will  be 
discussed  in  more  detail  in  Section  B. 
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4.  Knowledge  Acquisition 


Knowledge  acquisition  is  a  central  part  of  an  expert  system  [HART  86],  The 
expert  knowledge  must  be  collected,  examined  and  represented  in  a  logical  format.  This 
is  very  challenging,  as  many  tasks  in  the  identification  process  are  intuitive  to  the  expert 
and  therefore  difficult  to  define.  The  expert  collects  information  on  the  item,  its  location, 
other  mines  in  the  area,  the  mine’s  condition  and  the  mine’s  intended  target.  This 
information  is  used  by  the  expert  to  make  certain  inferences  about  the  mine  before  the 
mine  is  even  researched.  An  experienced  EOD  technician  can  determine  if  a  mine  is 
antipersonnel  or  antitank,  its  effect,  country  of  manufacture,  whether  it  is  a  scatterable 
mine,  and  its  method  of  actuation,  without  ever  having  seen  it  before. 

The  process  of  identifying  a  mine  is  complex,  involving  the  examination  of  many 
characteristics.  To  simplify  the  process,  the  problem  was  broken  down  into  individual 
questions  which  addressed  specific  characteristics  of  the  landmine  and  determined  which 
of  these  questions  were  supported  by  fields  in  the  database.  Further  examination  using 
the  landmine  set  allowed  me  to  identify  sub-questions  that  were  important  to  finding  a 
solution,  without  introducing  false  positive  or  ambiguous  answers  that  could  lead  to  an 
erroneous  conclusion. 

5.  Construction  of  a  Question  Set 

To  generate  the  questions  used  to  extract  query  information  from  the  deminer,  an 
examination  was  made  of  the  logical  process  that  is  used  by  expert  deminers  to  identify  a 
landmine.  As  discussed  in  Chapter  n,  EOD  technicians  use  a  combination  of  size  and 
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visual  recognition  to  make  a  positive  identification  of  a  landmine.  Closer  examination 
shows  that  visual  recognition  involves  several  steps.  The  first  is  the  collection  of  visual 
information  such  as  color  or  markings  that  will  be  used  to  compare  the  unknown  mine 
with  the  known  mines  in  the  identification  guides.  Next,  the  expert  makes  a  mental 
comparison  of  this  visual  information  from  the  unknown  mine  with  his  or  her  previous 
experience.  This  allows  the  technician  to  make  inferences  about  the  type  of  mine,  its 
function,  what  country  manufactured  it,  and  its  method  of  actuation.  These  inferences 
assist  in  making  a  positive  identification  and  reduce  the  risk  of  error. 

The  method  used  to  represent  the  rules  for  mine  taxonomy  was  the  question  tree 
shown  in  Figure  3.1.  This  method  is  similar  to  the  dichotomous  key  used  by  taxonomists 
to  determine  the  species  of  a  living  organism.  The  difference  is  that  the  trees  used  in  the 
expert  system  allow  for  more  than  two  answers  for  each  question.  Trees  were  based  on  a 
single  question  about  a  mine’s  attribute.  Following  the  question,  the  number  of  mines 


that  the  question  applied  to  would  be  listed  in  parentheses.  Each  question  was  fully 
explored  to  account  for  all  possible  answers  for  the  landmine  set.  These  answers  were 
listed  on  the  branches  of  the  question.  In  cases  where  the  answer  needed  further 
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refinement,  a  sub-question  was  developed  to  further  differentiate  the  answer.  An 
“unknown”  branch  was  added  where  appropriate  to  allow  the  question  to  be  left 
unanswered.  These  unknown  branches  are  discussed  further  in  Section  6,  below. 
Individual  question  trees  representing  a  query  are  displayed  in  Section  C.  There  is  no 
single  tree  displaying  all  the  questions.  If  the  questions  were  combined  into  one  tree  it 
would  be  so  large  that  it  would  be  difficult  to  display  or  understand. 

6.  Heuristics 

Once  the  question  trees  had  been  developed  the  next  step  was  development  of 
heuristics.  These  heuristics  are  based  on  general  landmine  information  and  are  used  to 
expand  the  available  data  on  the  unknown  mine.  This  is  done  by  applying  the  heuristics 
to  the  user  supplied  data.  The  heuristics  used  for  the  expert  system  are  explained  in  more 
detail  in  Section  D. 

7.  Dealing  with  Uncertainty 

This  topic  will  be  dealt  with  in  more  detail  in  Chapter  IV,  but  it  needed  to  be 
considered  when  the  questions  were  developed.  Throughout  the  question  process,  there 
were  several  instances  of  uncertain  data  and  uncertain  rules.  This  was  due  partly  to  the 
subjective  nature  of  some  questions  and,  in  some  cases,  the  lack  of  certainty  in  the 
database.  Some  questions  contained  both  certain  and  uncertain  outcomes.  One  example 
is  the  question  of  shape.  While  there  is  little  question  what  constitutes  a  cylinder,  the 
difference  between  a  rectangle  and  a  square  could  be  very  slight  and  necessitates  the 
taking  of  exact  measurements.  In  addition  to  subjective  uncertainty,  there  was  also 
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uncertainty  in  the  database,  in  fields  where  data  was  not  available.  Items  for  which  there 
is  no  available  information  must  be  included  on  every  possible  branch  of  the  question  tree 
to  ensure  they  are  not  erroneously  eliminated. 

The  “unknown”  branch  is  found  on  many  of  the  question  trees.  This  branch  is 
used  to  carry  all  mines  to  the  next  level  if  the  deminer  is  unable  to  provide  the  requested 
information.  In  some  cases,  the  “unknown”  branch  falls  under  a  sub-question,  and  in 
these  cases,  it  is  intended  to  collect  all  mines  of  that  sub-question  and  carry  them  to  the 
next  level.  Once  again,  this  may  be  due  to  missing  information  on  the  deminer’s  part,  or 
it  may  be  due  to  a  lack  of  specificity  on  the  part  of  the  database. 

8.  Application  of  the  Question  Trees  to  the  Landmine  Set 

To  test  the  possible  outcomes  from  the  question  trees,  truth  tables  were  developed 
for  all  the  landmine  attributes.  These  tables  list  each  mine,  and  the  attributes  that  that 
mine  can  have.  This  method  allowed  testing  of  the  questions  and  heuristics  to  investigate 
their  applicability.  The  complete  truth  tables  are  listed  in  Section  E. 

B.  MINEFACTS  DATABASE  ENGLDATA  TABLE 

This  section  presents  a  detailed  look  at  the  data  in  the  MineFacts  database.  There 
are  fifty-three  fields  in  the  ENGLDATA  table.  This  is  the  heart  of  the  MineFacts 
Database,  containing  all  the  text  information  on  each  mine.  In  addition  to  this  text  data, 
each  mine  also  has  one  or  more  photos  in  .BMP  format  that  are  linked  to  the  record  via 
the  ENGLRMKS  table. 
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While  most  of  the  fields  of  the  database  are  complete,  there  are  a  number  of  fields 
that  are  blank  or  have  non-standard  data.  Information  is  not  available  on  all  landmines,  as 
the  information  is  often  classified  or  simply  not  complete  when  it  was  collected. 
Nonstandard  data  presented  a  lack  of  continuity  within  some  fields.  For  example,  a 
“Cylinder”  was  also  referred  to  as  a  “Flat  Cylinder”  or  “Cylindrical”.  Also  some  fields 
had  remarks  added  such  as  the  size  “109mm  (not  including  the  tiltrod)”.  For  this  expert 
system,  blank  fields  were  treated  as  unknown,  and  inconsistencies  were  corrected. 

Table  3.1  below  shows  the  title  for  each  field  in  the  ENGLDATA  table  and  a 
description  for  each  field.  The  fields  that  were  used  for  the  expert  system  are  noted  with 
an  asterisk.  The  complete  ENGLRMKS  table  for  the  Bosnian  mines  can  be  found  in 
Appendix  A. 


Field  Name 

Field  Description 

MINEDD 

The  key  field  for  the  table 

*Nomenclature 

Mine  Name 

Country  of  origin 

Country  where  the  mine  was  developed 

Manufacturing  country 

Country(s)  where  the  mine  is  produced 

*Using  Country 

Country  where  the  mine  has  been  used 

*Mine  Type 

Antitank  or  antipersonnel 

*Case  Material 

What  material  is  used  to  construct  the  outer  case  e.g. 
metal,  plastic,  concrete 

*Number  of  fuze  wells 

The  number  of  the  exposed  fuze  wells  on  the  mine 

*Case  Color 

e.g.  OD  green,  black  gray  white 

*Effect 

Intended  effect  of  the  landmine.  Mines  can  be  blast, 
fragmentation,  directional  fragmentation,  bounding 
fragmentation,  Miznay-Schardin,  or  shaped-charge 

*Length 

Longest  side  of  rectangular  mine  in  millimeters, 
otherwise  blank 

*Width 

Shortest  side  of  rectangular  mine  in  millimeters, 
otherwise  blank 

*denotes  a  field  used  in  by  the  expert  system 
Table  3.1  Fields  in  the  ENGLDATA  Table 
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Field  Name 

Field  Description 

*Height 

From  base  to  top  of  mine  not  including  fuze  in 
millimeters 

^Diameter  -  Max 

For  cylindrical  mines,  only  in  millimeters,  otherwise 
blank 

*Diameter  -  Min 

For  cylindrical  mines,  only  in  millimeters,  otherwise 
blank 

Total  Weight 

Mine’s  weight  in  kilograms 

Main  Explosive  Weight 

Weight  of  the  main  explosive  in  the  mine  kilograms 

Non-Explosive  Weight 

Weight  of  all  non-explosive  components  kilograms 

Explosive  Type 

Explosive  filler  (e.g.  TNT,  RDX,  C-4) 

Booster  Charge  Weight 

Weight  of  explosive  booster  in  kilograms,  if  any 

Fuze  Model 

Model  and  nomenclature  of  fuze(s) 

Arm  Delay  -  Max 

Maximum  Time  allowed  for  arming  delay 

Arm  Delay  -  Min 

Minimum  Time  allowed  for  arming  delay 

Range 

Casualty  producing  range/maximum  effective  range 
in  meters 

Neutralization 

Acceptable  methods  for  to  neutralize  the  mine 

Max  Penetration 

For  Antitank  mines.  Max  armor  penetration  in 
millimeters 

Detonation  Height 

For  bounding  mines.  Height  of  detonation  above 
ground  in  meters 

Emplacement  Method 

Scatterable/manual  also  stake,  buried,  etc. 

Burial  Depth  -  Max 

Maximum  possible  depth  to  base  of  mine  in 
millimeters 

Burial  Depth  -  Min 

Minimum  possible  depth  to  base  of  mine  in 
millimeters 

Metal  Content 

Yes/No  and  description 

Metal  content  Amount 

Quantity  of  metal  in  mine 

Power  Source 

Yes/No  and  Description  of  mine  power  source,  if 
any 

Self  Destmct 

Yes/No  and  Time  to  self  destruction,  if  any 

Self  Neutralize 

Yes/No  and  Time  to  self  neutralization,  if  any 

^Detectability 

Yes/No  Magnetometer  Detectability 

Anti-handling 

Yes/No  if  present 

♦Underwater  Operations 

Yes/No  and  maximum  depth 

Description 

The  text  description  for  the  mine.  This  field  can  be 
2000  characters  long 

Techniques  of  employment 

Description  of  special  employment  techniques 

*denotes  a  field  used  in  by  the  expert  system 


Table  3. 1  (continued)  Fields  in  the  ENGLDATA  Table 
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Mine  plow  with  Dog  Bone 
General  Information 


Mine  plow  with  Dog  Bone 

Yes/No  if  mine  can  be  neutralized  with  a  Mine  Plow 

General  Information 

The  general  information  on  the  mine.  This  field  can 
be  2000  characters  long  and  contains  plain  English 
information  on  the  mine 

Characteristics 

Text  on  additional  characteristics 

Components 

Additional  components 

Fuze 

Additional  information 

Analysist’s  Information 

Additional  information 

Mine  Roller 

Yes/No  if  mine  can  be  neutralized  with  a  mine  roller 

Magnetic  Mine  Countermeasures 

Yes/No 

MICLIC 

Yes/No  if  mine  can  be  neutralized  with  a  MICLIC 

Bangalore  Torpedo/ APOBS 

Yes/No  if  mine  can  be  neutralized  with  a  Bangalore 
Torpedo 

Manual 

Yes/No  if  mine  can  be  neutralized  manually  by  any 
method 

Visual 

Visual  indications  (e.g.  tripwires,  tiltrods),  often 
blank 

Electronic 

Signals  from  the  mine 

*denotes  a  field  used  in  by  the  expert  system 
Table  3.1  (continued)  Fields  in  the  ENGLDATA  Table 


Because  of  the  problems  with  continuity  and  missing  fields  as  explained 
above,  the  expert  system  was  limited  to  the  following  fields;  Nomenclature,  Using 
Country,  Mine  Type,  Case  Material,  Number  of  Fuze  Wells,  Case  Color,  Effect,  Length, 
Width,  Height,  Min/Max  Diameter,  Detectability,  and  Underwater  Operations.  These 
fields  represented  the  most  important  data  on  each  mine  and  also  were  the  most  complete, 
with  fewest  blank  fields.  The  questions  used  to  query  these  data  fields  are  explained  in 
the  next  section. 


C.  QUESTION  SET 

The  questions  in  this  set  are  derived  from  information  an  expert  would  use  to 
make  an  identification  and  the  fields  that  were  available  from  the  ENGLDATA  table. 
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There  are  other  questions  that  the  fields  do  not  support,  and  some  of  those  questions  will 
be  found  in  the  heuristics  in  Section  D.  These  questions  are  presented  in  no  particular 
order,  except  in  the  case  of  sub-questions  for  the  shape  question  tree.  Each  question  tree 
diagram  displays  the  results  for  that  question  against  the  Bosnian  mine  set. 

1.  Shape 

Shape  is  an  obvious  attribute  from  the  MineFacts  database  that  can  be  requested 
from  the  deminer.  There  are  fourteen  different  shapes  in  the  MineFacts  database,  but  the 
Bosnian  set  only  displays  four  of  these:  cylindrical,  rectangular,  square,  and  egg-shaped. 
Over  87%  of  the  landmines  in  the  MineFacts  database  are  cylindrical  or  square  [MINE 
97].  The  remainder  of  the  mines  are  rectangular,  spherical  or  some  unique  shape.  The 
determination  of  the  mine’s  shape  will  lead  to  questions  about  the  length  and  width  or  the 
diameter  of  the  mine. 
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When  dealing  with  shape,  rectangular  and  square  mines  must  be  grouped  together 
at  this  level.  The  reason  is  that  the  deminer  may  only  have  an  approximate  measurement, 
and  may  mistake  a  rectangular  mine  for  square.  The  difference  between  length  and  width 
may  be  only  a  few  millimeters,  and  since  an  exact  measurement  is  not  always  possible,  all 
square  and  rectangular  mines  must  be  carried  through  the  tree  to  the  next  level. 

In  the  question  tree,  mines  with  unique  shapes  are  treated  as  “other”  and  will  be 
separated  for  identification  by  their  other  features.  These  mines  often  have  shapes  that 
are  difficult  to  describe  and  measurement  of  these  mines  may  be  subjective  and  error 
prone.  Luckily,  these  mines  make  up  a  minuscule  number  of  the  overall  mine  population, 
and  their  unique  shape  can  be  used  to  “zero-in”  on  their  identification. 

2.  Cylindrical  Size 


The  cylindrical  size  question  tree  is  given  below; 


The  next  query  level  after  shape  is  size.  This  question  is  based  on  the  answer  to 
the  shape  question  and  is,  “Do  you  have  the  exact  diameter  measurement  for  the 
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cylinder?”.  If  the  deminer  can  acquire  exact  measurements  for  the  unknown  mine  this 
will  greatly  limit  the  number  of  possible  mines.  While  an  exact  measurement  is 
preferred,  this  requires  close  examination  which  may  not  always  be  possible.  For  this 
reason,  the  deminer  may  approximate  the  mine’s  size  and  use  this  to  assist  in 
identification. 

The  cylindrical  size  question  tree  only  addresses  the  mine’s  diameter.  The 
cylindrical  mines  in  the  Bosnian  mine  set  can  be  nicely  divided  into  mines  larger  or 
smaller  than  150mm.  Within  the  Bosnian  set,  mine  diameters  in  the  “under  150mm” 
subset  range  between  32mm  and  103mm.  Mines  in  the  “over  150mm”  subset  range 
between  260mm  and  326mm.  These  size  ranges  generally  hold  true  for  the  entire  mine 
population  and  allow  for  approximations  to  be  made  with  a  high  degree  of  confidence. 
This  question  is  very  efficient  because  it  divides  the  set  of  cylindrical  mines  in  half. 

3.  Rectangular  Size 

Rectangular  mines  are  measured  by  width  and  length.  The  first  question  asked 
here  is,  “Do  you  have  an  exact  measurement  for  this  mine?”  (Figure  3.4).  If  the  answer  is 
yes  the  measurement  will  be  input.  If  the  answer  is  no,  the  next  question  is,  “What  is  the 
approximate  width?”.  To  answer  this,  width  must  be  defined.  For  our  purposes,  width  is 
assumed  to  be  the  shorter  of  the  two  measurements.  This  convention  was  not  universally 
followed  in  the  MineFacts  database,  and  one  field  from  the  Bosnian  set  had  to  be 
reversed.  Width  choices  are  offered  for  above  and  below  150mm.  This  range  was 
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selected  because  it  is  a  good  breakpoint  between  large  and  small  mines.  If  the  width 
cannot  be  approximated,  the  question  moves  to  the  next  level. 


Figure  3.4  Rectangular  Size  Question  Tree 

The  next  sub-question  in  this  tree  is,  “What  is  the  approximate  length  for  the 
mine?”.  Here  length  is  defined  to  the  user  as  the  longer  of  the  two  sides.  The  range 
remains  the  same  as  for  width,  above  or  below  150mm.  If  the  length  is  unknown,  all 
possible  mines  are  carried  on  the  unknown  branches.  This  question  is  very  efficient  and 
divides  the  rectangular  mines  in  the  landmine  set  into  three  smaller  groups. 

4.  Square  Size 

For  square  mines,  the  question  is  only  slightly  different  from  the  question  for 
rectangular  mines.  Once  again,  the  first  question  is  for  an  exact  measurement.  If  this  is 
unavailable,  the  sub-question  is,  “What  is  the  approximate  measurement  for  the 
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length/width  of  the  mine?”  (Figure  3.5).  Here  the  size  range  is  again  above  or  below 


150mm. 


In  the  landmine  set,  there  is  only  one  square  mine,  so  this  shows  no  distribution. 
In  the  entire  population  of  mines,  this  question  will  not  produce  much  differentiation. 
There  are  only  twenty-six  square  mines  in  the  MineFacts  database  and  only  two  are 
smaller  than  150mm. 

5.  Rectangular/Square  Size 

The  combined  shape  branch  of  rectangular  or  square  is  required  to  remove  some 
of  the  uncertainty  that  may  occur  if  an  exact  measure  is  unavailable.  As  stated  above,  this 
is  important  to  avoid  mistakes  when  the  difference  between  length  and  width  is  small  or 
the  mine  is  partially  obscured.  The  sub-questions  for  this  tree  are  very  similar  to  the 
rectangular  tree.  The  only  difference  is  that  the  exact  measurement  is  not  requested  and 
the  unknown  branch  appears  at  every  level  to  allow  for  partial  information.  (Figure  3.6) 
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Figure  3.6  Uncertain  Rectangular/Square  Size  Question  Tree 


6.  Height 

The  height  is  completely  unrelated  to  all  other  landmine  characteristics.  It  can  be 
difficult  to  get  for  buried  mines  and  requires  partial  excavation  of  the  mine.  Both  the 
antitank  and  antipersonnel  mines  were  distributed  over  the  whole  range  of  sizes.  The 
range  between  50mm  and  150mm  is  separated  from  the  ranges  above  and  below  by  a 
25mm  buffer.  Once  again,  an  exact  measurement  will  greatly  limit  the  number  of 
possible  mines  and  make  identification  much  easier.  (Figure  3.7) 
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7.  Case  Material 

Landmines  come  in  a  variety  of  case  materials.  Metal  and  plastic  are  the  most 
common,  but  mines  may  also  be  encased  in  cardboard,  fiberglass,  bakelite,  concrete  or 
rubber.  They  may  also  be  caseless,  cast  explosive.  The  division  of  case  material  is 
straight  forward  at  the  first  level.  Determination  is  not  difficult,  but  some  danger  of 
misclassification  exists,  such  as  between  fiberglass  and  plastic.  The  determination  of  a 
case  material  may  also  be  confused  by  long  exposure  to  the  elements. 

The  sub-types  of  this  question  allow  for  a  more  detailed  explanation  of  the  case 
material.  Because  sheet  metal  and  cast  metal  are  both  types  of  metal,  all  mines  of  this 
type  are  also  carried  on  the  unknown  branch.  The  unknown  branch  also  carries  all  other 
types  of  metal  construction  which  are  listed  in  the  database  as  unspecified  “metal”. 
(Figure  3.8) 
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The  plastic  sub-type  takes  into  account  the  use  of  rubber  with  some  plastic  mines. 
This  is  often  used  as  a  cover  for  the  mine’s  pressure  plate  and  will  be  visible  on  top  of  the 
mine.  If  the  deminer  is  unsure,  the  unknown  branch  again  carries  all  types  of  plastic 
mines  to  the  next  level. 


As  noted  before,  some  case  materials  often  are  difficult  to  distinguish  after 
weathering.  In  many  cases,  the  deminer  may  be  able  to  narrow  down  the  possible  case 
materials  to  two  or  three  possibilities.  In  these  cases  a  possible  method  for  querying  the 
user  would  be  to  allow  the  user  to  select  more  than  one  possible  answer  from  the  question 
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tree.  The  system  then  efficiently  extracts  the  information  from  the  deminer  and  reduces 
the  uncertainty  without  using  the  unknown  branch. 

8.  Color 

Mines  in  the  Bosnian  set  are  predominately  monochromatic.  Color  is  an  attribute 
that  is  extremely  subjective,  and  it  could  easily  lead  to  mistakes  if  too  many  options  are 
listed.  Most  mines  are  camouflaged  to  blend  in  with  their  intended  surroundings.  The 
most  common  color  is  olive  drab  (OD)  green,  but  black,  gray,  brown  and  unpainted  wood 
are  also  used.  Some  mines  are  produced  in  several  different  colors  for  use  in  different 
environments.  Mines  are  usually  only  one  solid  color,  but  some  may  have  additional 
components  of  a  different  color.  These  combinations  are  most  often  OD  green  and  black, 
where  black  is  the  color  of  additional  screw-in  fuze  adapters.  Figure  3.9  shows  the 
possible  answers  for  the  Bosnian  mines. 

Color  can  be  very  useful  to  the  deminer.  The  first  level  of  the  question  tree 
removes  mines  with  more  than  one  color  from  the  group.  The  second  level  addresses  the 
available  colors  for  the  mines.  Notice  that  green  is  also  reduced  to  light  green  and  OD 
green.  While  this  is  helpful  here,  it  would  be  even  more  helpful  to  add  more  choices  to 
this  category  in  an  expanded  system.  To  an  EOD  technician,  the  difference  between  light 
green  and  pea  green  is  significant  and  provides  important  clues  about  the  country  of 
origin  of  the  mine.  Although  additional  color  choices  could  be  helpful  for  the  expert 
deminer  it  would  most  certainly  cause  confusion  for  the  less  experienced. 
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Figure  3.9  Color  Question  Tree 

One  important  feature  to  notice  about  the  color  question  tree  is  that  the  branches 
at  each  level  add  up  to  more  than  the  initial  number  of  landmines.  This  is  because  some 
mines  come  in  more  than  one  color.  These  mines  must  be  carried  on  each  color  branch  to 
avoid  being  missed  as  possible  candidates. 

9.  Landmine  Effect 

The  intended  effect  of  a  landmine  is  an  esoteric  attribute  compared  to  the  other 
physical  characteristics  of  a  landmine.  The  question  asked  is,  “What  is  the  intended 
effect  of  the  landmine?”  (Figure  3.10).  The  effect  is  a  feature  that  may  not  be  apparent  in 
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Figure  3.10  Land  Mine  Effect  Question  Tree 


all  cases,  and  is  difficult  to  identify  without  some  experience  or  reference.  The  question 
tree  itself  is  a  straightforward  hierarchy,  with  no  unusual  levels.  However  this  knowledge 
itself  requires  a  certain  level  of  expertise. 

To  determine  the  possible  effect  of  a  mine,  a  trained  EOD  technician  will  examine 
the  size,  shape,  and  case  material.  The  technician  will  also  compare  the  mine  with  other 
mines  in  their  experience  base.  Because  this  question  is  difficult  for  the  novice  to 
answer,  heuristics  could  be  used  to  assist  in  the  determination  of  the  intended  effect  of  the 
unknown  mine.  By  using  the  information  that  the  deminer  is  able  to  gather,  the  effect 
could  possibly  be  determined,  or  if  the  deminer  did  select  an  effect,  it  could  be  checked 
against  the  heuristics  that  apply. 
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10.  Number  of  Visible  Fuze  Wells 


Fuze  wells  can  be  located  on  the  top,  sides  or  bottom  of  a  mine.  They  are  holes  in 
the  mine  case  that  allow  an  initiator  to  be  placed  in  contact  with  the  main  explosive 
charge.  A  fuze  well  can  be  used  for  the  main  fuze  or  for  an  anti-handling  device  to 
prevent  the  easy  neutralization  of  the  mine. 

The  question  tree  must  take  into  consideration  that  a  deminer  may  not  be  able  to 
see  all  of  the  fuze  wells  on  the  mine  due  to  the  mine  being  partially  obscured.  Landmines 
are  usually  buried,  and  though  the  deminer  may  partially  excavate  the  mine,  some  fuze 
wells  may  be  missed  or  may  not  be  visible  because  they  are  on  the  bottom  of  the  mine. 
For  these  reasons,  the  tree  is  constructed  so  that  the  smaller  number  branches  include 
mines  with  more  fuze  wells  to  account  for  miscounts.  As  an  example,  all  mines  are  listed 
on  the  “zero”  branch.  If  one  fuze  well  is  located  then  it  will  rule  out  the  mines  with  zero 


Figure  3.11  Number  of  Fuze  Wells  Question  Tree 
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fuze  wells.  The  deminer  can  answer  one  and  this  will  account  for  all  mines  with  one  or 
more  fuze  wells.  (Figure  3.1 1) 

To  assist  the  deminer  in  identifying  what  a  fuze  well  looks  like,  the  system  will 
have  to  present  an  explanation  and  several  examples  (Figure  3.12).  Some  mines  have 
holes  in  the  case  for  rope  handles  and  these  may  be  mistaken  as  fuze  wells.  Photographic 
representation  of  a  fuze  well  and  other  cavities  which  may  be  confused  with  a  fuze  well 
will  remove  some  of  the  uncertainty  from  this  question. 


Figure  3.12  PRB  M3  A1  Antitank  mine.  Secondary  fuze  well  is  noted  [MINE 

97] 

11.  Metal  Content 

The  MineFacts  database  has  a  field  that  notes  the  amount  of  metal  found  in  a 
landmine.  Landmines  can  contain  varying  amounts  of  metal,  and  modem  blast  mines 
may  be  completely  non-metallic.  Mines  containing  metal  can  be  located  with  a 
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magnetometer.  Once  a  mine  has  been  located,  a  trained  magnetometer  operator  can  easily 
determine  if  there  is  a  large  or  small  amount  to  metal  around  the  mine.  (Figure  3.13) 


Figure  3.13  Metal  Content  Question  Tree 
However,  detection  of  metal  around  a  mine  does  not  necessarily  mean  that  the 
mine  contains  metal.  The  landmine  could  be  booby-trapped  with  a  metallic  anti-handling 
device  to  prevent  its  removal,  or  the  area  could  be  contaminated  with  metal  from  an 
already  detonated  mine.  This  means  that  the  question  tree  cannot  confirm  the 
identification  of  metallic  mines,  it  can  only  confirm  mines  that  have  no  metal. 


Figure  3.14  Landmine  booby-trapped  with  a  grenade.  The  pin  is  removed  from  the 
grenade  and  the  mine  is  placed  on  the  spoon.  When  the  mine  is  moved,  the  grenade 
functions.  In  this  case,  a  non-metallic  mine  appears  metallic  to  the  magnetometer 

[SAPP  90]. 
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As  an  example,  if  the  non-metallic  TMA-5  mine  is  booby-trapped  with  a  hand 
grenade  (Figure  3.14),  it  will  produce  a  strong  signal  from  a  magnetometer.  If  the  system 
follows  the  “Detectable  with  a  magnetometer”  branch,  the  mine  could  be  erroneously 
eliminated.  To  prevent  the  wrong  path  being  followed,  the  branches  for  metallic  mines 
must  also  contain  the  non-metallic  mines. 

Once  metal  has  been  detected  around  the  mine,  a  trained  magnetometer  operator 
can  determine  if  the  signal  is  strong  or  weak.  A  weak  signal  confirms  low-metal  mines. 
It  cannot  rule  them  out  by  the  same  reasoning  that  non-metal  mines  can’t  be  ruled  out. 
This  portion  of  the  question  tree  must  also  be  weighted  to  take  into  consideration  the 
subjective  nature  of  “strong”  versus  “weak”  signals.  Magnetometers  are  not 
standardized;  several  factors  may  contribute  to  the  subjectivity  of  strong  versus  weak; 
operators  have  different  levels  of  training;  and  battery  power  often  affects  performance. 
The  answers  to  this  question  should  be  weighted  very  lightly. 


12.  Mine  Type  -  Intended  Target 


This  question  tree  asks  for  the  mine  type  or  intended  target. 


Antitank  (13) 


-D 


Intended  Taiget  (3Q)[^  /  Antipersonnel 


v^Unknown  (30) 


d 


Figure  3.15  Intended  Target  Question  Tree 
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The  question  asked  is,  “  What  is  the  intended  target  for  the  unknown  mine?”.  The 
answer  to  this  question  is  not  always  readily  apparent  to  the  deminer.  Often,  an 
experienced  deminer  can  easily  identify  a  mine’s  intended  target  by  its  size  or 
emplacement.  Larger  mines  tend  to  be  antitank  mines,  and  the  use  of  tiltrods  or 
emplacement  on  a  road  could  lead  the  deminer  to  believe  the  mine  was  antitank. 
Antipersonnel  mines  are  smaller  and  sometimes  use  tripwires  or  have  prong-type  fuzes. 
Inexperienced  deminers  may  not  be  able  to  answer  this  question,  but  if  they  provide 
enough  other  information,  the  heuristics  may  be  able  to  fill  in  the  blank  for  them. 

13.  Underwater  Capability 


The  underwater  capability  question  tree  is  given  below: 


Mine  Emplaced  Underwater  (30) 


No  (30) 


-□ 


o< 


Yes  (29) 


-a 


Figure  3.16  Underwater  Capability  Question  Tree 
Not  all  mines  can  be  used  underwater.  The  question  asked  here  is,  “Is  the  mine 
deliberately  emplaced  underwater?”.  Twenty-nine  of  the  Bosnian  mines  can  be  emplaced 
underwater  so  this  question  will  only  rule  out  one  mine  from  the  landmine  set.  This 
mine,  the  L.PZ.MI  antitank  mine,  uses  a  percussion  primer  and  will  not  function  if 
submerged.  This  question  is  not  as  straightforward  as  it  appears.  The  system  must  caveat 
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the  question  with  the  warning  to  ensure  the  mine  was  deliberately  emplaced  underwater, 
and  was  not  washed  into  a  river  or  flooded  following  emplacement.  Because  it  may  not 
be  obvious  whether  submerged  emplacement  was  deliberate,  this  question  will  also 
receive  a  reduced  weight  against  other  questions. 

14.  Country  of  Use 

The  country  of  use  can  be  a  very  useful  question  to  ask  of  the  deminer. 
Information  on  what  country  a  mine  is  being  used  in  is  usually  very  accurate.  Since  it  is 
obvious  what  country  the  deminer  is  working  in,  the  input  from  the  user  will  be  very 


Input  country  where  mine  is  bcatei 


County  of  use 


d< 


Unknown 


-o 


Figure  3.17  County  Where  Land  Mine  is  Located 
Question  Tree 

reliable.  With  respect  to  the  landmine  set  for  this  thesis,  this  question  has  already  been 
answered,  as  the  set  was  limited  to  only  Bosnian  mines.  (Figure  3.17) 


D.  HEURISTICS 

The  question  trees  that  are  listed  above  are  based  on  the  data  fields  in  the 
MineFacts  database.  Heuristics  allow  more  data  to  be  collected  from  the  deminer  by 
making  certain  inferences  based  on  the  basic  information  supplied  by  the  deminer.  The 
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heuristics  used  for  this  system  were  based  on  general  landmine  characteristics.  These 
rules  were  first  developed  with  words  to  show  some  degree  of  certainty  (e.g.  never,  rarely, 
sometimes,  often,  usually,  always).  Below  is  a  list  of  the  rules  used. 

•  Blast  mines  are  usually  plastic. 

•  Stake  mines  are  usually  cast  metal. 

•  Stake  mines  are  always  fragmentation. 

•  Tripwires  are  always  an  indication  of  an  antipersonnel  mine. 

•  Tilt-rod  actuated  mines  are  always  antitank  mines. 

•  Concrete  cased  mines  are  always  fragmentation. 

•  Cast  metal  mines  are  always  fragmentation. 

•  Antipersonnel  mines  are  usually  smaller  than  150mm  in  diameter  or  length. 

•  Antipersonnel  mines  rarely  have  carrying  handles. 

•  Antitank  blast  mines  are  usually  larger  than  150mm  in  diameter  or  length. 

•  Antitank  mines  are  usually  emplaced  on  roads. 

•  Square/rectangular  mines  are  never  shaped-charge  mines. 

•  Bounding  fragmentation  mines  are  always  antipersonnel  mines. 

•  Bounding  fragmentation  mines  are  usually  metal  cased. 

•  Bounding  fragmentation  mines  are  usually  round. 

•  Mines  with  prongs  are  always  antipersonnel. 

•  Mines  smaller  than  40mm  high  are  always  blast  mines. 

•  Cardboard  mines  are  always  blast  mines. 

•  Serrated  metal  case  mines  are  always  fragmentation. 

•  Fragmentation  mines  are  usually  emplaced  above  ground. 

•  Fragmentation  mines  are  always  antipersonnel. 

•  Miznay-Schardin  mines  are  usually  circular. 

•  Miznay-Schardin  mines  are  never  smaller  that  6  inches  in  diameter. 

•  Miznay-Schardin  mines  are  always  antitank. 

•  Directional  fragmentation  mines  are  usually  square. 

•  Directional  fragmentation  mines  are  usually  emplaced  vertically  with  the 
ground. 

These  rules  were  used  to  generate  heuristics  in  an  IF-THEN  format.  This  format 
will  allow  the  user-supplied  data  to  be  easily  evaluated,  and  the  reasoning  explained  to 
the  user.  As  an  example: 

IF  a  mine  has  a  carrying  handle, 

THEN  it  is  an  antitank  mine. 
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IF  a  mine  is  plastic, 

AND  it  has  no  metal, 

THEN  it  is  a  blast  mine. 

These  heuristics  are  used  to  fill  in  blanks  in  the  user  supplied  data,  make 
conclusions  and  also  to  check  user  input  against  known  rules.  As  an  example,  examine 
the  heuristic: 

IF  a  mine  is  has  a  wood  case, 

AND  it  has  2+  fuze  wells, 

THEN  it  is  an  antitank  mine. 

First,  the  inference  engine  checks  to  determine  if  the  user  has  supplied  the 
information  needed  for  this  heuristic.  If  the  information  isn’t  available,  the  heuristic  is 
skipped.  If  the  information  is  available,  as  in  this  case,  that  the  mine  is  wooden  and  has 
at  least  two  fuze  wells,  the  system  then  reasons  that  the  mine  is  an  antitank  mine.  There 
are  three  possible  outcomes  that  could  be  made  with  this  new  data: 

1.  If  the  user  did  not  specify  that  the  mine  was  an  antitank  mine,  the 
inference  engine  would  fill  in  that  blank. 

2.  If  the  user  did  specify  the  mine  was  an  antitank  mine,  then  the  system 
would  move  to  the  next  heuristic. 

3.  If  the  user  specified  that  the  mine  was  an  antipersonnel  mine,  the 
system  halts  and  asks  the  user  for  clarification  pointing  out  the 
inconsistency. 
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Once  this  heuristic  has  been  fully  explored,  the  system  moves  on  to  the  next  rule. 

The  information  from  the  first  heuristic  is  added  to  the  observed  data  and  can  be  used  for 

the  next  heuristic.  Assume  the  next  rule  states; 

IF  a  mine  is  antitank, 

AND  it  has  a  wood  case, 

THEN  it  is  a  blast  mine. 

If  the  first  rule  determined  that  the  mine  was  indeed  an  antitank  mine,  the  sub¬ 
conclusion  can  be  drawn  that  the  mine  is  also  a  blast  mine.  This  is  data  that  the  user 
could  not  provide,  and  is  valuable  for  making  a  final  conclusion  about  the  mine’s 
identification. 

Appendix  B  contains  a  complete  list  of  all  heuristics  used  in  the  expert  system. 

E.  TRUTH  TABLE 

To  determine  how  the  landmine  set  was  broken  down,  a  truth  table  was  developed 
displaying  the  answers  for  the  question  trees  against  the  list  of  the  Bosnian  mines.  They 
were  vital  for  the  construction  and  testing  of  the  expert  system.  Table  3.2  displays  the 
answers  for  the  shape,  size  and  height  questions. 

Table  3.3  below  displays  the  continuation  of  the  Bosnian  mine  truth  table.  This 
section  answers  the  case  material,  effect,  mine  type,  and  underwater  operations  questions. 
A  “Y”  indicated  an  attribute  does  not  apply  to  that  mine. 

Table  3.4  displays  the  last  page  of  the  Bosnian  mine  truth  table.  This  section 
answers  the  number  of  fuze  wells,  color  and  metal  content  questions.  The  fuze  well 
question  is  represented  here  with  the  actual  number  of  fuze  wells  first,  and  then  in  the 
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remaining  columns,  the  possible  number(s)  of  visible  fuze  wells.  The  magnetometer 
fields  are  used  to  describe  the  signal  level  received  when  determining  metal  content  of  a 
landmine.  Mines  could  all  be  identified  as  having  “zero”  visible  fuze  wells,  but  as  we 


move  across  the  table,  only  mines  with  more  fuze  wells  get  a  “Y”. 
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Table  3.2  Truth  table  for  the  Bosnian  landmine  set 
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M^T-76  Antitank  Mne 

Q/lindrical 

320  mm 

;7iyi-1C)0  Anfipersprnel  Mne 

C^irdrical 

*330  mm  107.0  mm 

TM^i^perwnnd  Mne 

RectangLiar  59,0  rmi 

32,0  rrm 

109.0  rrm 

TM^MAiJit^Mrie  _ 

CVlin^cal  j 

320  nm 

101.85  nm 

LPZM  Antit^Mne 

Rat  cvlinder  i 

266  rrm 

62  rrm 

PI\/R-TAn!ipefsq!Tiel  Mne. 

Cylindrical  i 

80  nm 

120  rrm 

PMfVIA^peregnnd  Mne 

Rectangular !  140.0  mm  68.0  mm 

31.0  rrm 

^P!\/R-2  ^personnel  Mne 

cylinder 

75  nm 

120  rrm 

Tiwys  Antitank  Mne 

Rectangular  312  mm 

275  rrm 

113  nm 

T1VFP::6  Antitank  Mne 

cylindrical 

290  rrm 

132  rrm 

MRLD  Antipersonnel  Mne 

Rectangular  231.0  nmri  46.0  nnm 

89.0  nm 

TM^2  Antitank  Mne  _ 

Rectangular  ^  3®,mm 

^mnn 

100  rrm 

TMAr3  Antitank  Mne 

CyiincKca!  ; 

265  rrm 

80  mm 

TMM  Antilank  Mne 

Cyiinclical  ^ 

280  mm 

65rrm 

PIVArl  Antipefsonnel  Mne 

Rectangular  140  mm 

70  mn 

30  nm 

,  PM^2.Antiperegmel  Mne _ 

Cy^irckicai 

68  mm 

30  nm 

;  PM^3  Antipersonnel  Mne 

cylindrical 

103  mm 

36  mm 

1 

cylindrical 

66  mm 

132  rrm 

FfDMI  Antipersonnel  Mne 

cylindrical  ^ 

75  nm 

178  mm 

TM-500 /^personnel  Mne 

Rectangular  70.0  mm 

50.0  rrm  : 

lOaOnm 

i  ^-4  ^perepmd^  M 

CyUndical 

94-0  rrm 

500.0  rrm 

PMRrSArtipersonnel  Mne 

Cyiindical 

78.0  mm 

134.0  mm 

iTlWVI  Antitank  Mne 

cylindrical 

315.0  nm 

100.0  nm 

iTiyp-2Antita^ 

Square 

JPWRSAS  Antipersonnel  Mne  * 

cyiindical 

66  nm 

132  rrm 

PSM-1  Antipersonnel  Mne 

cylindrical  L 

75.0  nm 

136.0  rrm 

M[>71  Antit^Mne 

Other 

260  nm 

jTMyi-1  Antitank  Mne 

cyiindical 

326.0  rrm 

90.0  rrm 

.lVpe©j^^ 

cyiindical 

270  rrm 

100  nm 

i  PiyD-1  Allipefsorinel  Mrie 

Rectangular  200  mrn 

89  mm 

64  rrm 

Table  3.3  Continuation  of  the  Truth  table  for  the  Bosnian  landmine  set 
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Table  3.4  Continuation  of  the  Truth  table  for  the  Bosnian  landmine  set 


F.  LIMITS  OF  THE  THESIS 

This  thesis  is  limited  in  several  respects.  First,  the  system  is  limited  to  only  thirty 


mines.  While  this  is  somewhat  representative  of  the  whole  population  of  700  mines,  it  is 


by  no  means  a  complete  system.  The  implementation  for  these  thirty  mines  makes 
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assumptions  and  inferences  based  only  on  this  set.  If  the  entire  700  mines  were  used, 
these  assumptions  and  questions  would  have  to  be  refined  and  re-tested.  The  second 
limitation  is  in  the  overall  design.  This  thesis  places  emphasis  on  the  EOD  knowledge  in 
this  expert  system.  It  may  not  represent  the  most  efficient  method  for  constructing  an 
expert  system.  That  said,  it  should  also  be  pointed  out  that  the  logic  used  for  the  EOD 
portion  is  sound  and  correct.  This  thesis  attempts  to  provide  a  proof  of  concept,  that  an 
expert  system  could  be  helpful  for  the  EOD  community  and  deminers. 
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IV.  IMPLEMENTATION 
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place,  the  user  (1)  can  begin  a  search  by  providing  information  to  the  user  interface  (1.2). 
This  is  facilitated  by  the  interface  providing  answer  choices  for  each  query.  Once  this 
information  is  collected,  it  is  integrated  with  the  heuristics  (D3)  to  infer  additional  data 
that  the  user  may  not  have  been  able  to  provide  (1.3).  The  observed  and  calculated  data 
are  passed  to  the  search  engine  (1.4).  The  search  engine  compares  this  data  with  an 
ASCn  version  of  the  MineFacts  database  to  determine  the  most  likely  landmine 
candidates.  These  candidates  are  output  to  the  screen  by  nomenclature  and  photo  for  final 
selection  by  the  user. 

B.  IMPLEMENTATION 

The  expert  system  was  implemented  on  an  IBM  PC  using  Microsoft  Excel  for 
Windows  95.  This  approach  was  used  to  model  and  test  the  weights  for  the  expert  system 
and  was  not  a  full  implementation  of  the  heuristics  or  decision  trees.  This  method  was 
selected  to  allow  the  rapid  prototyping  of  question  weights,  which  required  extensive 
manipulation  and  testing.  The  immediate  output  supplied  by  the  spreadsheet  allowed  the 
numbers  to  be  quickly  changed  and  evaluated.  An  analytical  programming  language 
would  not  have  allowed  this  type  of  testing. 

Ultimately,  this  program  should  be  fully  implemented  using  C-H-,  Java  or  Ada  to 
allow  for  the  user  interface  and  data  handling  features  that  these  t5q)es  of  languages  offer. 
A  full  implementation  could  also  take  advantage  of  an  expert  system  shell  (ESS),  which 
would  speed  construction  by  providing  a  framework  for  input  of  the  knowledge  base, 
heuristics  and  weights. 
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1. 


Construction 


The  model  is  designed  to  test  weights,  and  model  the  use  of  some  simple 
heuristics.  Table  4.1  is  a  scaled  down  sample  from  the  model.  Observed  data  is  entered 
on  the  bottom  row  of  the  table,  and  each  mine  receives  a  probability  value  (P)  for  each 
question  based  on  the  observed  data.  If  an  observed  characteristic  closely  matches  that 
characteristic  for  the  mine,  it  receives  a  number  close  to  1.0,  if  it  clearly  doesn’t  match  it 
receives  a  number  close  to  0.0.  Unknown  receives  0.5. 


NOMENCLATURE 

Shape 

(Pi) 

Case 

Material 

(P2) 

HQSHI 

MAT-76 

Cyl 

0.90 

FIB 

0.30 

15.90 

69.13% 

TM-100 

Cyl 

0.90 

PLA 

0.30 

15.90 

69.13% 

TM-200 

Rec 

0.01 

PLA 

0.30 

2.55 

11.09% 

TM-62M 

Cyl 

0.90 

MET 

0.99 

21.42 

93.13% 

L.PZ.MI 

Cyl 

0.90 

PLA 

0.30 

15.90 

69.13% 

PMR-1 

Cyl 

0.90 

CAR 

0.05 

13.90 

60.43% 

PMA-1A 

Rec 

0.01 

PLA 

0.30 

2,55 

11.09% 

PMR-2 

Cyl 

0.90 

CON 

0.05 

13.90 

60.43% 

TMA-5 

Rec 

PLA 

0.30 

2.55 

11.09% 

Field  Weights 

15 

8 

23 

100.00% 

Observed  Data 

CYL 

MET 

Table  4. 1  Shows  the  format  used  for  the  EOD  associate  model. 


The  probability  value  is  then  multiplied  with  the  question  weight  (W)  to  give  a 
confidence  factor.  Confidence  factors  for  all  questions  are  summed  to  get  a  Total  Weight 
for  each  Landmine  (TWL).  This  total  weight  is  divided  by  the  Total  Field  Weight  (TFW) 
to  get  the  Likelihood  Value  (LV)for  each  mine. 

W1P1+W2P2+ . WiPi  =  TWL 

Wi  +  W2  + . Wi  =  TFW 

TWL/TPW  =  LV 
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2.  Question  Weights  and  Answer  Probabilities 

There  are  several  possible  outcomes  for  the  questions  used  by  the  model.  The 
answers  to  these  questions  are  assigned  probabilities  to  account  for  uncertainty.  This 
uncertainty  may  be  because  the  answer  is  difficult  to  determine,  or  the  answer  is  very 
similar  to  other  possible  answers. 

a.  True/False  Questions 

Tme  or  false  answers  are  weighted  as  1.0  or  0.0  respectively.  There  is  no 
uncertainty  about  the  possible  answers.  Some  examples  of  this  type  of  question  are, 
“does  the  mine  have  a  tripwire?”  or,  “is  the  mine  a  stake  mine?”. 

b.  Choice  from  Several  Clear  Choices 

This  is  a  question  with  multiple  answers,  but  there  is  a  clear  separation 
between  the  possible  answers.  With  this  type  of  question,  the  user’s  answer  is  assumed  to 
be  correct  since  the  answers  are  not  subjective.  As  an  example,  the  Shape  question 
assumes  that  the  user  can  select  the  correct  shape  from  the  given  choices  of  “cylindrical”, 
“rectangular”,  “square”,  or  “other”.  For  answers  where  the  user  could  be  mistaken,  say 
between  rectangular  and  square  shapes,  the  question  is  handled  as  a  choice  from  several 
unclear  choices,  as  explained  below  in  Section  C. 

c.  Choice  from  Several  Unclear  Choices 

This  situation  results  when  some  of  the  answers  are  similar  to  each  other. 
The  case  material  question  presents  exactly  this  type  of  problem.  The  case  material  for  a 
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mine  may  not  always  be  easy  to  determine,  especially  if  the  mine  has  been  exposed  to  the 
elements.  A  user  may  look  at  the  mine  and  not  be  able  to  tell  if  it  is  plastic  or  fiberglass, 
though  they  are  pretty  sure  it  isn’t  metal  and  are  positive  it  isn’t  made  of  wood  or 
concrete.  To  account  for  this  uncertainty,  weights  were  given  to  each  different  case 
material  based  on  its  “similarity”  to  another  material.  Table  4.2  shows  the  matrix  used  in 
the  Excel  model  to  manage  the  case  material  weights.  A  value  of  .99  is  a  perfect  match, 
.01  is  no  match,  and  0.50  is  the  value  for  “Unknown”. 


OBSERVED 

Material 

Plastic 

Plastic/ 

Rubber 

Fiberglass 

Metal 

Sheet 

Metal 

Cast 

Metal 

Cardboard 

Concrete 

Wood 

Plastic 

0.99 

0.95 

0.85 

0.30 

0.30 

0.05 

0.05 

0.05 

0.05 

Plastic/Rubber 

0.95 

0.99 

0.65 

0.30 

0.30 

0.05 

0.05 

0.05 

0.05 

Fiberglass 

0.85 

0.65 

0.99 

0.30 

0.30 

0.05 

0.05 

0.05 

0.05 

Metal 

0.30 

0.30 

0.30 

0.99 

0.99 

0.99 

0.05 

0.05 

0.05 

Sheet  Metal 

0.30 

0.30 

0.99 

0.99 

0.99 

0.25 

0.05 

0.05 

0.05 

Cast  Metal 

0.05 

0.05 

0.99 

0.99 

0.25 

0.99 

0.05 

0.35 

0.05 

Cardboard 

0.05 

0.05 

0.05 

0.05 

0.05 

0.05 

0.99 

0.05 

0.35 

Concrete 

0.05 

0.05 

0.05 

0.05 

0.05 

0.35 

0.05 

0.99 

0.05 

Wood 

0.05 

0.05 

0.05 

0.05 

0.05 

0.05 

0.35 

0.05 

0.99 

Table  4.2  Matrix  of  weights  used  for  case  material,  where  some  items  may  be 
easily  confused  with  another. 


Notice  the  “plastic”  row  in  Table  4.2.  An  answer  of  “Plastic”  in  the 
observed  column  would  produce  weights  of  0.99  for  all  the  plastic  mines,  0.95  for  the 
rubber  and  plastic  mines,  and  0.85  for  the  fiberglass  mines.  The  metal  mines  receive  0.30 
as  that  category  includes  some  sheet  metal  mines,  and  the  sheet  metal  category  also 
receives  0.30.  The  reasoning  behind  these  weights  is  that  fiberglass  could  easily  be 
mistaken  for  plastic  so  it  receives  the  high  weight  of  0.85.  Sheet  metal  is  not  likely  to  be 
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mistaken,  but  it  is  possible  if  the  mine  was  dirty  or  wet,  so  it  is  assigned  a  value  of  0.30,  a 
value  that  is  nearer  to  unknown. 

d.  Closeness  to  Value  (Ranges) 

Ranges  are  used  for  the  “size”  questions  in  the  model.  When  the  user 
inputs  a  measurement  for  a  size  question,  there  must  be  some  allowance  for  error.  This 
could  be  done  by  applying  weights  to  the  possible  range  of  input  values  (Table  4.3).  For 
example,  if  a  mine  was  +/-  .05  mm  from  the  size  input  by  the  user,  the  certainty  factor 
would  be  0.99.  As  the  difference  from  the  actual  size  increases,  the  certainty  factor 
decreases.  Sizes  that  are  greater  than  5  mm  off  the  exact  size  are  given  a  certainty  factor 
of  0.01. 


Difference  from  Mine’s 

Exact  Size 

Certainty 

Factor 

+/-  0.5  mm 

0.99 

+/- 1.0  mm 

0.9 

+/-  2.0  mm 

0.8 

+/-  3.0  mm 

0.5 

+/-  4.0  mm 

0.25 

>  +/-  5.0  mm 

0.1 

Table  4.3  This  table  shows  the  weights  for  ranges  when  an  exact  measure  is  given  for  an 
item.  These  certainty  factors  assume  that  exact  measurements  are  made  using  calipers.  If 
an  exact  measurement  is  not  available,  the  user  can  always  use  the  approximate  ranges  to 

describe  the  size. 


In  the  model,  exact  measurements  were  not  addressed.  But  this  same 
method  works  for  ranges.  As  an  example,  the  possible  approximations  for  a  mine’s 
diameter  are  less  than  150  mm  and  greater  than  150  mm.  If  a  mine  is  135  mm  in 
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diameter,  it  could  be  given  a  certainty  factor  of  0.95  for  an  answer  of  less  than  150  mm 
and  0.30  for  an  answer  of  greater  than  150  mm.  This  would  allow  some  level  of  error  in 
the  case  the  user’s  size  estimate  was  incorrect. 

e.  Weighting  Questions 

Another  way  to  model  the  logic  with  the  information  available  is  to  weight 
certain  questions  based  on  their  potential  value  or  the  overall  certainty  of  their  answers. 
In  the  model,  questions  were  assigned  weights  between  one  and  twenty.  A  question  with 
a  weight  of  twenty,  for  example,  is  considered  twenty  times  more  important  than  a 
question  with  a  weight  of  one. 

The  “shape”  question  was  given  a  weight  of  fifteen  in  the  model.  It 
received  this  weight  because  the  user  can  be  expected  to  easily  make  a  correct 
determination  of  the  mine’s  shape.  Also,  this  question  provides  a  great  deal  of 
differentiation  within  the  data  set,  and  a  heavy  weight  will  amplify  that  differentiation  in 
the  results.  An  example  of  a  lightly  weighted  question  is  the  “underwater  emplacement” 
question.  Here  the  user  is  asked  if  the  mine  was  deliberately  emplaced  underwater.  This 
question,  while  having  only  two  possible  answers,  is  very  uncertain.  A  mine  found 
underwater  could  have  been  washed  there,  or  could  have  been  flooded  after  it  was 
emplaced.  Also,  this  question  also  will  only  eliminate  one  mine  from  the  data  set.  For 
these  reasons,  this  question’s  value  is  very  limited,  and  it  is  given  a  low  weight. 
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e. 


Heuristic  Certainty  Factors 


The  heuristics  are  weighted  with  a  certainty  factor  that  is  determined  by 

the  reliability  and  quality  of  the  data  input  into  the  heuristic.  This  value  is  important 

when  the  calculated  data  is  used  to  fill  in  for  data  that  the  user  did  not  observe.  For 

purposes  of  heuristic  weights,  observed  data  is  assumed  to  have  a  certainty  of  1 .0  on  a 

scale  of  0.0  to  1 .0.  Data  calculated  with  a  heuristic  may  have  a  certainty  factor  lower  than 

1 .0,  because  it  may  use  data  that  is  uncertain  or  error  prone.  This  certainty  value  is  used 

to  modify  the  answer  weight  for  a  mine.  Note,  for  example,  the  heuristic  below: 

IF  a  mine  is  smaller  than  150mm  in  diameter  or  length, 

AND  it  is  less  than  50  mm  in  height, 

THEN  it  is  an  antipersonnel  mine  (0.75) 

Because,  this  heuristic  deals  with  size,  there  is  a  possibility  of  uncertainty 
in  the  generated  answer.  The  input  data,  that  the  mine  is  a  certain  size  may  be  error  prone 
since  sizes  may  be  approximate.  Also,  while  this  heuristic  is  almost  always  true,  it  is  not 
always  true.  However,  there  are  only  two  antitank  mines  for  the  700  known  landmines 
which  could  fit  this  heuristic.  For  these  reasons,  the  certainty  factor  for  this  heuristic  is 
set  at  0.75.  If  the  heuristic-generated  answer  “antipersonnel”  is  used,  the  overall  weight 
for  that  question  will  be  affected:  Antitank  mines  which  are  lightly  weighted  at  0.05,  will 
move  slightly  higher,  whereas,  antipersonnel  mines  which  are  weighed  as  0.95  will  move 
lower. 
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3.  Proposed  Outputs 

The  model  will  produce  an  overall  certainty  for  each  mine  in  the  Bosnian  set  and 
list  the  top  five  values.  The  full  implementation  for  the  program  would  offer  three 
possible  outcomes  based  on  the  input  and  calculated  data. 

a.  Top  Five 

If  the  user  has  input  enough  information  to  limit  the  database  to  a  near 
match,  the  top  five  candidates  will  be  displayed  on  the  screen.  This  display  would  show 
the  nomenclature,  the  certainty  factor  and  a  picture  of  the  candidate  mines.  Figure  4.4 
shows  an  example  of  how  this  information  could  be  shown  if  the  program  had  a  GUI 
written  for  it. 


b.  None  Acceptable 

If  the  results  fail  to  meet  a  threshold  value  set  by  the  expert  system 
programmer,  the  system  should  offer  no  candidates  to  the  user.  This  minimum  threshold 
is  used  to  protect  the  user  from  candidate  mines  with  confidence  values  that  are 
dangerously  low.  Since  the  render-safe  procedure  is  based  on  the  mine’s  identification,  a 
poor  answer  is  worse  than  providing  the  user  with  no  answer.  If  the  search  failed  to 
produce  acceptable  results,  the  user  would  be  informed  that  the  information  provided 
produced  no  acceptable  candidates.  The  user  would  be  prompted  for  a  new  search,  and 
cautioned  to  recheck  the  input  information. 
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c.  Too  many  acceptable 

In  some  cases  the  input  and  calculated  information  provided  may  leave 
more  than  three  acceptable  candidates.  When  this  occurs,  the  user  is  informed  that  not 
enough  information  is  available  to  make  an  exact  determination.  The  user  could  then  be 
allowed  to  page  through  the  available  choices,  enter  more  information,  or  begin  a  new 
search. 

C.  TESTING  AND  RESULTS 

The  model  was  tested  in  several  ways.  For  the  first  test,  all  available  data  for  each 
landmine  was  entered  to  see  if  the  system  could  identify  it  with  the  highest  confidence 
level.  The  model  was  able  to  do  this  for  twenty  of  the  thirty  mines  in  the  Bosnian  set. 
The  remaining  ten  mines  were  identified  with  the  highest  value,  but  were  tied  with 
another  mine.  A  print-out  of  the  results  for  each  mine  can  be  found  in  Appendix  C. 

The  model  was  next  tested  to  determine  how  well  it  handled  incomplete 
information.  Instead  of  entering  all  the  data  on  a  mine,  only  70%  of  the  data  was  input. 
For  this  test,  the  less  obvious  attributes  were  excluded  and  only  shape,  color,  number  of 
fuze  wells  and  approximate  length/width  or  diameter  was  used.  In  this  test  the  model  was 
able  to  place  the  correct  mine  amongst  the  top  three  candidates  87%  of  the  time.  The 
exception  in  this  test  was  with  the  stake  mine  category.  For  these  mines,  the  system 
could  not  do  better  than  a  four  way  tie.  This  tie  was  only  broken  when  the  case  material 
attribute  was  added  to  the  available  data. 
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The  last  test  involved  having  a  non-expert  select  four  mines  at  random  from  the 
Bosnian  set.  The  novice  then  attempted  to  describe  the  mines  using  the  pictures  and 
some  limited  data  from  the  database.  The  results  of  this  test  are  listed  in  Table  4.4. 
Notice  that  the  novice  included  incorrect  information,  once  for  number  of  fuze  wells  and 
once  for  case  material.  These  mistakes  did  lower  the  confidence  factor,  and  for  the  PMD- 
1  caused  the  correct  mine  to  fall  to  second  place. 


Name 

Data  Supplied  (Incorrect  data) 

Results 

Confidence 

PMA-2 

Shape,  Approximate  Diameter,  Case  material. 

Tm-100 

81.07% 

Color,  Number  of  fuze  wells. 

PMA-2 

81.07% 

PMR-1 

Shape,  Approximate  Height  and  Diameter, 

PMR-1 

82.72% 

Case  Material,  Color,  (Number  of  fuze  wells) 

PMR-3 

82.72% 

Stake  Mine 

PSM-1 

82.72% 

PMD-1 

Shape,  Approximate  Height,  Length  and 

TMD-2 

62.62% 

Width,  (Case  material),  Color,  Number  of  fuze 

wells 

PMD-1 

62.43% 

TMA-2 

Shape,  Approximate  Height,  Length  and 

TMA-2 

86.06% 

Width,  Case  material.  Color,  Number  of  fuze 

wells 

TMA-5 

81.40% 

Table  4.4  Results  from  tests  using  non-expert  supplied  data. 


D.  PROPOSED  USER  INTERFACE 

The  user  interface  for  this  system  serves  two  important  functions.  First,  it  is  the 
method  that  the  user  will  use  to  communicate  with  the  system.  The  second  purpose,  is  to 
extract  the  important  information  about  the  mine  from  the  user.  To  accomplish  these 
tasks,  the  interface  must  be  robust,  displaying  all  possible  choices  with  explanations  and 
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examples.  The  proposed  interface  for  the  EOD  Associate  can  be  divided  into  three 
sections:  Query,  Explanation,  and  Results. 


1.  Query  Screen 

The  expert  system  asks  the  user  questions  about  the  unknown  landmine  with  a 
query  screen.  Figure  4.2  shows  a  possible  layout  for  such  a  screen.  The  questions  should 
be  brief,  and  all  fit  on  one  page  if  possible.  This  will  speed  data  entry  once  the  user 
understands  the  program.  Questions  are  listed  with  pull-down  boxes  containing  all  the 
possible  answers  in  a  multiple-choice  type  format.  This  focuses  the  user  on  the  answers 


EOD  Associate 


Select  Characteristics 
about  the  unknown 
mine  from  the  list  below. 


SHAPE 
HEIGHT 
LENGTH: 
WIDTH: 
DIAMETER: 
COLOR: 
METAL  CONTENT: 
CASE  MATERIAL: 
COLOR: 

EMPLACED  UNDERWATER 


IUNKNOWN  J 
[|^§J0WN“ 


UNKNOWN 


UNKNOWN 


“3 


UNKNOWN 


UNKNOWN 


3 


IUNKNOWN 


|UNI^(JWN 

3 


UNKNOWN 
NUMBER  OF  FUZE  WELLS:  |0 


Check  any  boxes  which 
apply  to  the  unknown 
mine. 


O  Is  it  a  Slake  Mine? 

Does  it  have  a  Carrying 
Handle? 

fj  Does  ithaveaTripewire? 
C  Does  it  have  a  Tiltrod? 


FORM ' 
SEARCH 

exit'  "I 


Figure  4.2  Example  of  a  GUI  to  be  used  with  the  EOD  Associate. 
Notice  that  all  fields  on  the  User  Query  page  default  to  “Unknown”. 
The  “HELP”  buttons  take  the  user  to  a  screen  with  examples  and  text 
describing  the  requested  field. 
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that  are  recognized  by  the  system.  When  the  user  supplies  no  answer  for  a  specific 
characteristic,  the  system  defaults  to  “Unknown”. 


2.  Explanation  Screen 

In  many  cases,  the  user  may  not  understand  the  question  asked  or  may  want  more 
information  about  the  possible  answers.  By  pressing  the  “HELP”  button,  the  user  can 
link  to  an  explanation  screen  with  more  information.  This  help  screen  could  contain  text 
and  graphical  explanations  of  the  question  and  possible  answers.  Figure  4.3  shows  a  help 
screen  for  the  question  “Is  it  a  stake  mine?”.  In  this  case,  key  features  are  listed  and 
examples  are  shown. 


STAKE  MINES 

A  Stake  mine  is  a  mine  that  is  secured  to  a  stake  and  emplaced 
above  the  ground.  This  type  of  mine  is  omni-directional 
fragmentation,  but  could  be  easily  confused  with  a  directional 
fragmentation  mine.  These  mines  normally  are  tripwire  actuated. 

Helpful  ID  features: 

*Often  Cylinder  or  can  shaped 
*Many  are  made  of  casf-metal 
“Look  for  a  serrated  body 

Back 


Figure  4.3  This  an  example  of  a  help  screen  to  assist  the  user  with  more  detailed 
information  about  questions  on  the  User  Query  page. 
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More  detailed  help  screens  could  be  layered  to  produce  a  very  robust  reference 
library.  This  layered  data  could  be  very  helpful  when  describing  subjective  questions 
such  as  color.  For  this  type  of  question,  the  help  screen  could  show  examples  of  the 
possible  colors,  and  discuss  factors  which  may  alter  a  mine’s  color.  The  help  screen 
could  even  show  the  examples  of  the  effects  of  fading,  or  examples  of  mines  with  unusual 
colors.  The  amount  of  data  available  can  increase  the  quality  of  the  user  supplied  input. 

3.  Results  Screen 

Once  the  user  has  entered  all  the  available  information  on  the  mine,  candidate 
landmines  are  displayed  on  the  results  screen.  Figure  4.4  is  a  sample  output  screen.  In 


EOD  Associate 

The  mine  listed  below  are  the  top  three  choices  based  on  the 
information  provided. 


MORE  MINES  ^ 
NEWSMOH 
EXIT 


TMA-4  Aniilank  mine 

81.86^ 

Confidence 

Morelnfoimalion  I 


Figure  4.4  This  is  an  example  of  a  GUI  page  to  display  the  results  of  a 
search.  The  confidence  values  are  from  an  actual  search  for  the  TMM- 
1  landmine  on  the  model  expert  system. 
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this  example,  the  top  three  candidate  mines  are  shown  with  photo,  nomenclature  and 
confidence  value.  The  key  feature  of  this  screen  is  that  the  user  can  make  the  final 
determination  of  the  correct  mine,  and  this  is  easily  done  with  a  photograph.  The  user 
can  then  link  to  more  information  about  the  desired  mine  with  the  “More  Information” 
button. 
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V.  SUMMARY 


A.  SUMMARY  OF  WORK 

Landmine  clearance  is  one  of  the  most  pressing  problems  in  the  world  today.  In 
order  for  humanitarian  deminers  to  perform  this  task  they  must  first  be  able  to  quickly 
and  accurately  identify  unknown  landmines.  The  existing  methods  for  landmine 
identification  involve  tedious  searching  through  reference  books,  looking  for  a  line 
drawing  that  matches  the  unknown  item  or  paging  through  a  CD-ROM  reference  such  as 
the  MineFacts  database. 

This  thesis  presented  the  use  of  an  expert  system  for  landmine  identification.  The 
system  is  based  on  the  set  of  thirty  Bosnian  mines  from  the  MineFacts  landmine  database 
on  CD-ROM.  The  methodology  involved  first  creating  questions  based  on  the  more 
obvious  attributes.  Heuristics  were  then  developed  to  describe  general  characteristics  of 
the  landmine  set.  The  user  is  queried  about  the  unknown  landmine  and  the  answers  are 
applied  to  heuristics  which  are  then  used  to  calculate  other  information  about  the  mine. 
This  collection  of  information  is  then  filtered  through  decision  trees  to  generate  candidate 
landmines.  A  small  group  of  candidates  are  displayed  with  a  confidence  factor  based  on 
each  question  weight  and  the  supplied  answer. 

The  system  was  implemented  on  an  Microsoft  Excel  spreadsheet.  This  allowed 
testing  of  the  weights  used  for  the  questions  and  answers..  The  completed  system  was 
based  on  fifty-one  heuristics  and  fourteen  landmine  attributes.  The  system  can  narrow 
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candidates  to  within  two  choices  when  all  queries  are  correctly  answered  and  to  within 
three  candidates  when  70%  of  the  queries  are  correctly  answered. 

The  results  from  the  research  show  that  this  technique  has  potential  for  all  types  of 
ordnance  identification.  A  similar  system  could  be  implemented  to  cover  all  UXOs  and 
be  used  by  EOD  technicians.  It  could  also  be  used  as  a  reconnaissance  tool  by  non-EOD 
trained  individuals. 

B.  THESIS  QUESTIONS 

The  following  questions  are  addressed  in  this  thesis: 

•  Can  an  expert  system  be  useful  in  landmine  identification? 

Yes,  the  implementation  for  the  system  shows  that  an  expert  system  does  have 
usefulness  in  landmine  identification.  With  the  implementation  of  a  GUI,  the 
system  would  provide  the  user  a  much  faster  and  easier  method  of  searching  the 
landmine  database. 

•  How  is  expert  landmine  knowledge  described?  How  is  the  knowledge  best 
extracted? 

Expert  knowledge  is  best  described  as  expert  experience.  Knowledge  is 
represented  by  bits  of  information  about  landmine  characteristics,  and  ordnance 
identification  is  largely  pattern  matching.  This  knowledge  is  best  represented 
using  heuristics  based  on  the  landmines.  Extraction  of  this  knowledge'  was  done 
using  questions  and  heuristics. 
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•  What  methodology  is  best  suited  for  the  landmine  identification  problem? 

The  methodology  used  for  this  thesis  involved  determining  the  bounds  of  the 
database,  developing  questions  based  on  those  bounds  and  then  developing 
heuristics  to  support  those  questions.  The  question-tree  format  was  very  helpful 
in  identifying  the  attributes  for  each  mine.  These  attributes  were  then  examined  to 
determine  what  general  heuristics  could  be  formed  to  make  inferences  about  other 
attributes.  Once  the  questions  and  heuristics  were  developed  the  system  was 
implemented  on  the  Excel  spreadsheet. 

•  What  questions  and  sub-questions  are  best  to  implement  an  expert  system  that 
will  integrate  well  with  the  MineFacts  database? 

The  MineFacts  system  presented  basic  questions  on  shape,  size,  case  material  and 
country  of  use.  These  were  expanded  to  cover  more  visual  aspects  of  the  mine, 
but  the  expert  system  was  limited  by  the  fields  available  in  the  MineFacts 
database.  A  complete  list  of  the  questions  used  is  in  Chapter  HI,  Section  C.  The 
use  of  a  GUI  to  query  the  user  would  greatly  enhance  the  quality  of  the  system  to 
extract  information. 

•  What  are  possible  applications  for  similar  expert  systems  that  could  be 
applied  to  other  EOD  databases? 

The  results  to  this  thesis  show  that  an  expert  system  has  potential  for  all  ordnance 
identification.  The  EOD  community  could  easily  use  this  technology  to  improve 
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the  speed  and  accuracy  of  ordnance  identification.  Further  discussion  about  these 
uses  is  found  in  Section  C  below. 

C.  RECOMMENDATIONS  FOR  FUTURE  STUDY 

1.  Add  the  Complete  landmine  Set  to  the  EOD  Associate 

The  EOD  Associate  covers  only  thirty  of  the  landmines  currently  in  use 
worldwide.  Since  the  program  is  based  on  the  MineFacts  database  it  could  be  expanded 
to  cover  the  complete  mine  set.  This  would  allow  deminers  to  easily  identify  landmines 
with  only  one  reference.  It  could  also  allow  reconnaissance  of  minefields  by  non¬ 
deminers  for  referral  to  landmine  clearance  teams.  Any  expansions  require  some 
modifications  to  the  database,  heuristics,  and  questions. 

As  noted  earlier,  there  are  some  consistency  problems  in  certain  fields  of  the 
MineFacts  database.  This  problem  was  easily  handled  with  the  small  set  used  for  the 
program,  but  will  have  to  be  corrected  before  the  full  database  can  be  used  with  an  expert 
system.  The  number  of  different  descriptions  appearing  in  the  fields  is  unimportant,  but 
duplicate  types  must  match  in  case  and  spelling. 

In  addition  to  changes  to  the  MineFacts  database,  the  EOD  Associate  will  have  to 
be  adjusted  to  account  for  the  larger  variety  of  values.  As  an  example,  the  Bosnian  mine 
set  has  only  four  shapes  and  eight  possible  case  materials.  The  complete  database  will 
expand  those  fields  to  sixteen  and  fifteen  respectively.  These  additional  variables  are 
sometimes  sub-categories  of  existing  variables.  In  some  cases  they  can  be  consolidated 
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with  other  categories  to  reduce  confusion,  but  many  will  have  to  be  added  to  the 
heuristics  and  decision  trees. 

2.  EOD  60-Series  Publications 

An  expert  system  approach  also  has  potential  application  to  the  60-series 
publications.  As  previously  noted  in  Chapter  H,  the  method  of  searching  the  60-series  has 
not  been  up-dated  to  make  full  use  of  the  computer’s  processing  power.  The  search 
method  still  requires  the  EOD  technician  to  make  subjective  judgements  about  the  type  of 
ordnance  being  searched,  and  also  does  not  make  use  of  identifying  features  besides  size 
to  assist  in  the  identification.  EOD  Associate,  or  some  other  expert  system  could  improve 
speed  and  accuracy  by  offering  more  categories  and  a  friendlier  user  interface. 

The  60-series  publications  will  require  some  modifications  to  allow  an  expert 
system  to  use  the  data  collected  on  it.  Although  the  current  60-series  is  on  CD-ROM,  it  is 
only  an  automated  version  of  the  old  microfiche  publications.  To  make  it  compatible  to 
an  expert  system,  a  machine-readable  database  needs  to  be  developed  to  allow  application 
of  heuristics  and  searches.  This  database  could  be  used  by  the  EOD  technician  for  a 
simple  query,  or  in  conjunction  with  the  expert  system.  Additionally,  the  current  line- 
drawings  of  ordnance  would  need  to  be  catalogued  and  available  for  display  individually 
to  allow  the  user  to  see  available  choices  on  one  screen.  This  could  be  improved  further 
if  the  line-drawings  were  supplemented  with  digitized  photographs  of  the  ordnance. 
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3. 


C4I EOD  Reconnaissance  System 


One  last  application  for  an  expert  system  is  as  part  of  a  C4I  system  to  improve 
EOD  reconnaissance  and  reporting.  Tactical  EOD  reconnaissance  is  now  done  by 
untrained  personnel  who  encounter  a  UXO  hazard.  The  collection  and  reporting  of  the 
information  to  the  EOD  unit  is  not  automated  and  is  subject  to  errors.  Often,  the 
reporting  personnel  gather  incomplete  or  inaccurate  information,  and  the  EOD  Control 
unit  must  make  decisions  about  the  UXO’s  disposition  based  on  that  information.  To 
combat  this  incorrect  information  and  poor  communication,  a  PC  based  system  could  be 
developed  for  issue  to  field  units  as  an  EOD  reconnaissance  tool.  Figure  5.1  shows  one 
possible  implementation  of  such  a  system.  When  a  UXO  is  found,  the  EOD 
reconnaissance  computer  would  be  used  to  gather  all  the  necessary  information  about  the 
item  without  requiring  the  individual  doing  the  reconnaissance  to  remain  in  the  danger 
area  for  an  extended  period.  The  user  could  take  a  photo  of  the  ordnance  using  a  tethered 
digital  camera.  The  computer  would  collect  a  grid  coordinate  for  the  item  from  the 
Global  Positioning  System  also  tethered  to  the  system.  The  user  could  then  retreat  to  a 
safe  area,  and  enter  the  additional  data  about  the  ordnance.  The  expert  system  could  be 
used  to  prompt  for  and  check  the  information  provided  by  the  user.  Once  this  has  been 
accomplished,  the  photo  and  collected  data  could  be  relayed  to  the  EOD  Control  Unit  by 
wire,  radio,  or  satellite. 
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Figure  5.1  Layout  for  EOD  Recon  System 


This  type  of  system  would  increase  the  speed  and  accuracy  of  UXO  reporting. 
The  EOD  control  could  easily  interpret  which  ordnance  was  hazardous  and  required 
immediate  attention,  and  which  could  be  left  for  later  disposal. 

D.  LESSONS  LEARNED 

There  are  several  things  I  learned  during  the  course  of  this  thesis  that  could  be  of 
benefit  to  others  working  on  similar  projects.  First,  the  data  from  the  database  must  be 
correctly  formatted.  Problems  with  data  consistency  and  missing  data  must  be  addressed 
early  in  the  project’s  design.  The  database  should  also  be  machine  readable  to  allow  easy 
exchange  of  data  between  the  database  and  the  expert  system. 
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An  expert  system  shell  would  be  very  helpful  for  an  expert  system  such  as  this 
one.  It  would  reduce  the  complexity  of  the  programming  by  providing  a  framework  for 
the  knowledge  and  logic.  An  ESS  would  greatly  speed  the  system’s  development  time. 

Landmine  and  UXO  identification  require  a  high  degree  of  certainty  to  prevent 
accidents.  For  this  reason,  a  significant  amount  of  time  should  be  devoted  to  the 
development  of  heuristics,  weights  and  testing  for  the  expert  system.  There  is  no  way  to 
assure  100%  accuracy  in  the  output,  but  every  opportunity  should  be  taken  to  eliminate 
the  possibility  of  a  dangerous  mistake. 

E.  CONCLUSION 

Expert  systems  have  tremendous  potential  for  landmine  identification.  Even  more 
important  are  the  potential  benefits  that  expert  systems  offer  for  the  explosive  ordnance 
disposal  community.  EOD  technicians  must  identify  ordnance  quickly  and  accurately 
with  information  that  is  not  always  complete.  This  thesis  has  discussed  ways  that  an 
expert  system  can  improve  accuracy,  speed  search  time,  and  increase  available 
information  to  solve  these  problems.  There  is  no  tolerance  for  a  mistake  when  identifying 
landmines,  and  an  expert  system  can  help  ensure  that  the  identification  is  always  correct. 
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APPENDIX  B  -  HEURISTICS 


The  following  Heuristics  apply  to  the  entire  population  of  landmines: 

IF  a  mine  is  plastic, 

AND  it  has  no  metal, 

THEN  it  is  a  blast  mine  (0.99) 

IF  a  mine  has  a  wood  case, 

AND  it  has  2  or  more  fuze  wells, 

THEN  it  is  Antitank  Mine  (0.95) 

IF  a  mine  is  smaller  than  150mm  in  diameter  or  length, 

AND  it  is  less  than  60  mm  in  height, 

THEN  it  is  an  antipersonnel  mine  (0.99) 

IF  a  mine  is  less  that  40mm  in  height, 

THEN  it  is  a  blast  mine  (0.99) 

IF  a  mine  has  a  carrying  handle, 

THEN  it  is  an  antitank  mine  (0.99) 

If  a  mine  is  square/rectangular, 

AND  it  is  emplaced  vertically  with  the  ground, 

THEN  it  is  a  directional  fragmentation  mine  (0.95) 

IF  a  mine  is  fiberglass, 

AND  it  has  no  metal, 

THEN  it  is  a  blast  mine  (0.99) 

IF  a  mine  is  wood, 

AND  it  has  no  metal, 

THEN  it  is  a  blast  mine  (.99) 

IF  a  mine  is  caseless, 

THEN  it  is  a  blast  mine  (0.99) 

IF  a  mine  is  on  a  stake, 

THEN  it  is  a  fragmentation  mine  (0.98) 
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IF  a  mine  has  prongs 

THEN  it  is  an  antipersonnel  mine 

IF  a  mine  is  cast  metal 

THEN  it  is  a  fragmentation  mine  (0.99) 

IF  a  mine  is  fragmentation, 

THEN  it  is  antipersonnel  (0.99) 

IF  a  mine  is  directional  fragmentation, 

THEN  it  is  antipersonnel  (0.99) 

IF  a  mine  is  bounding  fragmentation, 

THEN  it  is  antipersonnel  (0.99) 

IF  a  mine  is  concrete  cased, 

THEN  it  is  a  fragmentation  mine  (0.99) 

IF  a  mine  is  cardboard  cased, 

THEN  it  is  a  Blast  mine  (0.99) 

IF  a  mine  is  blast, 

AND  it  is  antipersonnel, 

THEN  it  is  plastic  (0.60) 

IF  a  mine  has  Shaped-charge  effect, 

THEN  it  is  antitank  (0.99) 

IF  a  mine  is  Miznay-Schardin, 

THEN  it  is  antitank  (0.99) 

The  following  Heuristics  apply  to  this  Bosnian  landmines: 

IF  a  mine  is  cylindrical, 

AND  it  is  antitank, 

AND  it  is  not  light  green, 

THEN  it  is  a  blast  mine  (0.95) 

IF  a  mine  is  cylindrical, 

AND  it  is  light  green, 

THEN  it  is  a  PMA-2  antipersonnel  Mine(0.95) 
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IF  a  mine  is  cylindrical, 

AND  it  is  antitank, 

AND  it  is  OD  green, 

THEN  it  is  a  blast  mine  (0.95) 

IF  a  mine  has  a  fiberglass  case, 

THEN  it  is  an  antitank  mine  (0.95) 

IF  a  mine  is  cylindrical, 

AND  it  has  a  diameter  >  150mm, 

THEN  it  is  an  antitcink  mine  (0.95) 

IF  a  mine  is  cylindrical, 

AND  it  has  a  plastic  case, 

AND  it  is  blast, 

THEN  it  is  an  antipersonnel  mine(0.95) 

IF  a  mine  is  cylindrical, 

AND  its  has  a  fiberglass  case, 

THEN  it  is  a  blast  mine  (0.95) 

IF  a  mine  is  cylindrical, 

AND  its  has  a  fiberglass  case, 

THEN  it  is  an  antitank  mine  (0.95) 

IF  a  mine  is  fiberglass, 

THEN  it  is  a  blast  mine  (0.95) 

IF  a  mine  has  5  fuze  wells, 

THEN  it  is  an  L.PZ.MI  Antitank  Mine(0.95) 

IF  a  mine  has  4+  fuze  wells, 

THEN  it  is  an  antitank  mine  (0.95) 

IF  a  mine  is  gray, 

THEN  it  is  a  L.PZ.MI  Antitank  Mine  (0.95) 

IF  a  mine  is  light  green, 

AND  it  is  >  150mm, 

THEN  it  is  an  TMRP-6  Antitank  Mine(0.95) 

IF  a  mine  is  light  green, 

AND  it  is  <  150mm, 
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THEN  it  is  a  PMA-2  antipersonnel  Mine(0.95) 

IF  a  mine  is  OD  green  and  Black, 

THEN  it  is  a  antipersonnel  mine(0.95) 

IF  a  mine  is  OD  green  and  Black, 

AND  it  is  >  than  75mm, 

THEN  it  is  a  PMA-3  Antipersonnel  Mine(0.95) 

IF  a  mine  is  OD  green  and  Black, 

AND  it  is  >  than  75mm, 

THEN  it  is  a  fragmentation  mine(0.95) 

IF  a  mine  has  a  wood  case, 

THEN  it  is  blast  (0.95) 

IF  a  mine  has  a  wood  case, 

AND  it  has  2+  fuze  wells, 

THEN  it  is  TMD-2  Antitank  Mine(0.95) 

IF  a  mine  is  antitank 
AND  it  has  a  wood  case, 

THEN  it  is  a  blast  mine  (0.95) 

IF  a  mine  has  a  wood  case, 

AND  it  is  rectangular, 

THEN  it  is  an  antipersonnel  (0.95) 

IF  a  mine  is  egg  shaped, 

THEN  it  is  a  MC-71  Antitank  Mine  (0.95) 

IF  a  mine  is  square, 

THEN  it  is  TMD-2  Antitank  Mine(0.95) 

IF  a  mine  rectangular, 

AND  it  is  an  antitank  mine, 

THEN  it  is  a  blast  (0.95) 

IF  a  mine  has  a  sheet  metal  case, 

THEN  it  is  cylindrical  (0.95) 

IF  a  mine  is  metal  cased, 

AND  it  is  blast. 
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THEN  it  is  an  antitank  mine  (0.95) 

IF  a  mine  has  a  metal  case, 

AND  it  has  prongs, 

THEN  it  is  a  Bounding  fragmentation  mine  (0.95) 

IF  a  mine  is  concrete, 

THEN  it  is  PMR-2(0.95) 

IF  a  mine  has  a  rubber  cover, 

THEN  it  is  a  PMA-3  antipersonnel  mine  (0.95) 

IF  a  mine  has  a  plastic  case, 

AND  it  has  prongs, 

THEN  it  is  a  blast  mine  (0.95) 

IF  a  mine  has  Shaped-charge  effect, 

THEN  it  is  a  MC-71  Antitank  Mine  (0.95) 

IF  a  mine  has  no  metal, 

THEN  it  is  a  TMA-5  (0.95) 
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APPENDIX  C  -  WEIGHTS  USED  IN  THE  EODA  MODEL 
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Shape 


Height 


'  fy&i '  'V '  " 


U  :;U<; 
'  tzjyi\V 

O  - . 


'  ,3  J:' ' 

MAT-76  Antitank  Mine  Cylindrical  0.99  0.01  0.01 

TM-1 00  Antipersonnel  Mine  Cylindrical  0.99  0.01  0.01 

TM-200  Antipersonnel  Mine  Rectangular  0.01  0.99  0.40 

TM-62M  Antitank  Mine  Cylindrical  0.99  0.01  0.01 

L.PZ.MI  Antitank  Mine  Flat  cylinder  0.99  0.01  0.01 

PMR-1  Antipersonnel  Mine  Cylindrical  0.99  0.01  0.01 

PMA-1A  Antipersonnel  Mine  Rectangular  0.01  0.99  0.20 

PMR-2  Antipersonnel  Mine  Cylinder  0.99  0.01  0.01 

TMA-5  Antitank  Mine  Rectangular  0.01  0.99  0.45 

TMRP-6  Antitank  Mine  Cylindrical  0.99  0.01  0.01 

MRUD  Antipersonnel  Mine  Rectangular  0.01  0.99  0.10 

TMA-2  Antitank  Mine  Rectangular  0.01  0.99  0.45 

TMA-3  Antitank  Mine  Cylindrical  0.99  0.01  0.01 

TMA-4  Antitank  Mine  Cylindrical  0.99  0.01  0.01 

PMA-1  Antipersonnel  Mine  Rectangular  0.01  0.99  0.20 

PMA-2  Antipersonnel  Mine  Cylindrical  0.99  0.01  0.01 

PMA-3  Antipersonnel  Mine  Cylindrical  0.99  0.01  0.01 

PMR-2A  Antipersonnel  Mine  Cylindrical  0.99  0.01  0.01 

PROM-1  Antipersonnel  Mine  Cylindrical  0.99  0.01  0.01 

TM-500  Antipersonnel  Mine  Rectangular  0.01  0.99  0.45 

MT-4  Antipersonnel  Mine  Cylindrical  0.99  0.01  0.01 

PMR-3  Antipersonnel  Mine  Cylindrical  0.99  0.01  0.01 

TMA-1  Antitank  Mine  Cylindrical  0.99  0.01  0.01 

TMD-2  Antitank  Mine  Square  0.01  0.80  0.99 

PMR-2AS  Antipersonnel  Mine  Cylindrical  0.99  0.01  0.01 

PSM-1  Antipersonnel  Mine  Cylindrical  0.99  0.01  0.01 

MC-71  Antitank  Mine  Other  0.60  0.01  0.01 

TMM-1  Antitank  Mine  Cylindrical  0.99  0.01  0.01 

Type  69  Antitank  Mine  Cylindrical  0.99  0.01  0.01 

PMD-1  Antipersonnel  Mine  Rectangular  0.01  0.99  0.15 


0.01  Unknown 
0.01  107.0  mm 
0.01  109.0  mm 
0.01  101.85  mm 
0.01  62  mm 
0.01  120  mm 
0.01  31.0  mm 
0.01  120  mm 
0.01  113  mm 
0.01  132  mm 
0.01  89.0  mm 
0.01  100  mm 
0.01  80  mm 
0.01  65  mm 
0.01  30  mm 
0.01  30  mm 
0.01  36  mm 
0.01  132  mm 
0.01  178  mm 
0.01  108.0  mm 
0.01  500.0  mm 
0.01  134.0  mm 
0.01  100.0  mm 
0.01  Unknown 
0.01  132  mm 
0.01  135.0  mm 
0.99  Unknown 
0.01  90.0  mm 
0.01  100  mm 
0.01  64  mm 


0.50  0.50 
0.01  0.99 
0.01  0.99 
0.01  0.99 
0.69  0.90 
0.01  0.99 
0.99  0.01 
0.01  0.99 
0.01  0.99 
0.01  0.96 
0.10  0.97 
0.01  0.99 
0.20  0.97 
0.60  0.90 
0.99  0.01 
0.99  0.01 
0.99  0.01 
0.01  0.96 
0.01  0.40 
0.01  0.99 
0.01  0.01 
0.01  0.97 
0.01  0.99 
0.50  0.50 
0.01  0.96 
0.01  0.97 
0.50  0.50 
0.08  0.95 
0.01  0.99 
0.60  0.90 


0.50  0.50 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.20  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.01 
0.01  0.99 
0.01  0.01 
0.01  0.01 
0.50  0.50 
0.01  0.01 
0.01  0.01 
0.50  0.50 
0.01  0.01 
0.01  0.01 
0.01  0.01 


MAT-76  Antitank  Mine 
TM-100  Antipersonnel  Mine 
TM-200  Antipersonnel  Mine 
TM-62M  Antitank  Mine 
L.PZ.MI  Antitank  Mine 
PMR-1  Antipersonnel  Mine 
PMA-1A  Antipersonnel  Mine 
PMR-2  Antipersonnel  Mine 
TMA-5  Antitank  Mine 
TMRP-6  Antitank  Mine 
MRUD  Antipersonnel  Mine 
TMA-2  Antitank  Mine 
TMA-3  Antitank  Mine 
TMA-4  Antitank  Mine 
PMA-1  Antipersonnel  Mine 
PMA-2  Antipersonnel  Mine 
PMA-3  Antipersonnel  Mine 
PMR-2A  Antipersonnel  Mine 
PROM-1  Antipersonnel  Mine 
TM-500  Antipersonnel  Mine 
MT-4  Antipersonnel  Mine 
PMR-3  Antipersonnel  Mine 
TMA-1  Antitank  Mine 
TMD-2  Antitank  Mine 
PMR-2AS  Antipersonnel  Mine 
PSM-1  Antipersonnel  Mine 
MC-71  Antitank  Mine 
TMM-1  Antitank  Mine 
Type  69  Antitank  Mine 
PMD-1  Antipersonnel  Mine 


Rectangular/Square 

■■ 

'''<r 

ISIS 

1!;.- 

l-t"' 

Sli 

ij.., 

.V* 

'.I:' 

■■E-r. 

.  O'  S'. 

m 

Ayr,,'' 

,A  fK 

' 

•  O'. 

;«o 

6.6b 

6.00 

0.00 

6.00 

0.00 

0.00 

0.00 

0.00 

59.C 

mm 

0.99 

0.01 

32.0  mm 

0.99 

0.01 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

140 

0  mm 

0.90 

0.60 

68.0  mm 

0.99 

0.01 

0.00 

0.00 

0.00 

0.00 

312 

mm 

0.01 

0.99 

275  mm 

0.00 

0.00 

0.00 

0.00 

231. 

0  mm 

0.02 

0.97 

46.0  mm 

0.99 

0.01 

330 

mm 

0.01 

0.99 

260  mm 

0.01 

0.99 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00  ; 

140 

mm 

0.90 

0.60 

70  mm 

0.99 

0.01 

0.00 

0.00 

0.00 

0.00  f 

0.00 

0.00 

0.00 

0.00  ■ 

0.00 

0.00 

0.00 

0.00  ( 

0.00 

0.00 

0.00 

0.00  ■ 

70.0 

mm 

0.99 

0.01 

50.0  mm 

0.99 

0.01 

0.00 

0.00 

0.00 

0.00  < 

0.00 

0.00 

0.00 

0.00  ■ 

0.00 

0.00 

0.00 

0.00  : 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00  ( 

0.00 

0.00 

0.00 

0.00  i 

0.00 

0.00 

0.00 

0.00  2 

0.00 

0.00 

0.00 

0.00  ' 

0.00 

0.00 

0.00 

0.00  2 

200 

mm 

0.10 

0.95 

89  mm 

0.99 

0.01 
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Material 


I^W§$MXmy 

'  O  '  i'"' '  - '  v ' 


'C  ;v 

^  l^l  ^''  I'*  ^  A 
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;,  ifj^f  ■ 
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MAT-76  Antitank  Mine  0.85  0.65  0.30 

TM-1 00  Antipersonnel  Mine  0.99  0.75  0.30 

TM-200  Antipersonnel  Mine  0.99  0.75  0.30 

TM-62M  Antitank  Mine  0.30  0.30  0.99 

L.PZ.MI  Antitank  Mine  0.30  0.30  0.99 

PMR-1  Antipersonnel  Mine  0.30  0.30  0.99 
PMA-1A  Antipersonnel  Mine  0.99  0.75  0.30 
PMR-2  Antipersonnel  Mine  0.05  0.05  0.05 

TMA-5  Antitank  Mine  0.99  0.75  0.30 

TMRP-6  Antitank  Mine  0.99  0.75  0.30 

MRUD  Antipersonnel  Mine  0.99  0.75  0.30 

TMA-2  Antitank  Mine  0.99  0.75  0.30 

TMA-3  Antitank  Mine  0.85  0.65  0.30 

TMA-4  Antitank  Mine  0.99  0.75  0.30 

PMA-1  Antipersonnel  Mine  0.05  0.05  0.05 

PMA-2  Antipersonnel  Mine  0.99  0.75  0.30 

PMA-3  Antipersonnel  Mine  0.95  0.99  0.30 

PMR-2A  Antipersonnel  Mine  0.30  0.30  0.99 
PROM-1  Antipersonnel  Mine  0.30  0.30  0.99 
TM-500  Antipersonnel  Mine  0.99  0.75  0.30 
MT-4  Antipersonnel  Mine  0.05  0.05  0.05 
PMR-3  Antipersonnel  Mine  0.05  0.05  0.99 
TMA-1  Antitank  Mine  0.99  0.75  0.30 

TMD-2  Antitank  Mine  0.05  0.05  0.05 

PMR-2AS  Antipersonnel  Mine  0.30  0.30  0.99 
PSM-1  Antipersonnel  Mine  0.30  0.30  0.99 
MC-71  Antitank  Mine  0.30  0.30  0.99 

TMM-1  Antitank  Mine  0.30  0.30  0.99 

Type  69  Antitank  Mine  0.99  0.75  0.30 

PMD-1  Antipersonnel  Mine  0.05  0.05  0.05 


0.05  0. 
0.05  0, 
0.05  0, 
0.99  0. 
0.25  0. 
0.99  0. 
0.05  0, 
0.35  0. 
0.05  0. 
0.05  0. 
0.05  0. 
0.05  0. 
0.05  0. 
0.05  0, 
0.05  0. 
0.05  0, 
0.30  0. 
0.99  0. 
0.99  0. 
0.05  0, 
0.05  0. 
0.99  0. 
0.05  0. 
0.05  0. 
0.99  0. 
0.25  0, 
0.99  0. 
0.25  0. 
0.05  0. 
0.05  0. 


-  <  1 

05  0.99" 
05  0.85 
05  0.85 
05  0.30 
05  0.30 
05  0.30 
05  0.85 
05  0.05 
05  0.85 
05  0.85 
05  0.85 
05  0.85 
05  0.99 
05  0.85 
99  0.05 
05  0.85 
05  0.65 
05  0.30 
05  0.30 
05  0.85 
35  0.05 
05  0.05 
05  0.85 
99  0.05 
05  0.30 
05  0.30 
05  0.30 
05  0.30 
05  0.85 
99  0.05 


0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.99  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.35 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.99 
0.35  0.05 
0.05  0.05 
0.05  0.35 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.05 
0.05  0.35 


Antitank 

Antipersonnel 

Antipersonnel 

Antitank 

Antitank 

Antipersonnel 

Antipersonnel 

Antipersonnel 

Antitank 

Antitank 

Antipersonnel 

Antitank 

Antitank 

Antitank 

Antipersonnel 

Antipersonnel 

Antipersonnel 

Antipersonnel 

Antipersonnel 

Antipersonnel 

Antipersonnel 

Antipersonnel 

Antitank 

Antitank 

Antipersonnel 

Antipersonnel 

Antitank 

Antitank 

Antitank 

Antipersonnel 


0.99  0.01 
0.01  0.99 
0.01  0.99 
0.99  0.01 
0.99  0.01 
0.01  0.99 
0.01  0.99 
0.01  0.99 
0.99  0.01 
0.99  0.01 
0.01  0.99 
0.99  0.01 
0.99  0.01 
0.99  0.01 
0.01  0.99 
0.01  0.99 
0.01  0.99 
0.01  0.99 
0.01  0.99 
0.01  0.99 
0.01  0.99 
0.01  0.99 
0.99  0.01 
0.99  0.01 
0.01  0.99 
0.01  0.99 
0.99  0.01 
0.99  0.01 
0.99  0.01 
0.01  0.99 
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Effect 
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Hi  1 '  v; . 
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■ 

MAf-76  Antitank  Mine 

0.99 

6.01 

0.01 

0.01 

0.01 

0.6  f 

6~.20 

0.95" 

0.40 

T26 

“6.70 

'o^ 

"o.lio 

TM-100  Antipersonnel  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

TM-200  Antipersonnel  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

TM-62M  Antitank  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

L.PZ.MI  Antitank  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.20 

0.20 

0.95 

0.20 

0.20 

0.10 

PMR-1  Antipersonnel  Mine 

0.01 

0.01 

0.01 

0.99 

0.10 

0.10 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

PMA-1A  Antipersonnel  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.95 

0.20 

0.70 

0.20 

0.10 

PMR-2  Antipersonnel  Mine 

0.10 

0.01 

0.01 

0.99 

0.10 

0.10 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

TMA-5  Antitank  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

TMRP-6  Antitank  Mine 

0.30 

0.99 

0.01 

0.01 

0.01 

0.01 

0.20 

0.70 

0.20 

0.20 

0.95 

0.20 

0.10 

MRUD  Antipersonnel  Mine 

0.10 

0.01 

0.01 

0.40 

0.99 

0.05 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

TMA-2  Antitank  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

TMA-3  Antitank  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

TMA-4  Antitank  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

PMA-1  Antipersonnel  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.95 

PMA-2  Antipersonnel  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.95 

0.20 

0.10 

PMA-3  Antipersonnel  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.95 

0.40 

0.40 

0.20 

0.20 

0.20 

0.10 

PMR-2A  Antipersonnel  Mine 

0.01 

0.01 

0.01 

0.99 

0.10 

0.10 

0.95 

0.40 

0.40 

0.20 

0.20 

0.20 

0.10 

PROM-1  Antipersonnel  Mine 

0.01 

0.01 

0.01 

0.99 

0.10 

0.10 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

TM-500  Antipersonnel  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

MT-4  Antipersonnel  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.20 

0.95 

0.20 

0.20 

0.95 

0.10 

PMR-3  Antipersonnel  Mine 

0.01 

0.01 

0.01 

0.99 

0.10 

0.10 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

TMA-1  Antitank  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

TMD-2  Antitank  Mine 

0.99 

0.20 

0.01 

0.01 

0.01 

0.01 

0.10 

0.10 

0.10 

0.10 

0.10 

0.10 

0.95 

PMR-2AS  Antipersonnel  Mine 

0.01 

0.01 

0.01 

0.99 

0.10 

0.10 

0.95 

0.40 

0.40 

0.20 

0.20 

0.20 

0.10 

PSM-1  Antipersonnel  Mine 

0.01 

0.01 

0.01 

0.99 

0.10 

0.99 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

MC-71  Antitank  Mine 

0.01 

0.01 

0.99 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

TMM-1  Antitank  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

Type  69  Antitank  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 

PMD-1  Antipersonnel  Mine 

0.99 

0.01 

0.01 

0.01 

0.01 

0.01 

0.20 

0.95 

0.40 

0.20 

0.70 

0.20 

0.10 
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Number  of  Fuze  Wells 


k ',  ^;2  -k%  /I".- ;(kJ;'  ■ .  ;, 

1  ‘ 


,S^  A0t'>' 

><U'%  ^  :kiN:k:'  3:';<»%r 

:-.3>  :  '  <'<IL  ^  3  / 


'''a-A'''/:''c  'A'A'  \ 


ri'V'-'^^^'^L?''. 


MAT-76  Antitank  Mine 
TM-100  Antipersonnel  Mine 
TM-200  Antipersonnel  Mine 
TM-62M  Antitank  Mine 
L.PZ.MI  Antitank  Mine 
PMR-1  Antipersonnel  Mine 
PMA-1 A  Antipersonnel  Mine 
PMR-2  Antipersonnel  Mine 
TMA-5  Antitank  Mine 
TMRP-6  Antitank  Mine 
MRUD  Antipersonnel  Mine 
TMA-2  Antitank  Mine 
TMA-3  Antitank  Mine 
TMA-4  Antitank  Mine 
PMA-1  Antipersonnel  Mine 
PMA-2  Antipersonnel  Mine 
PMA-3  Antipersonnel  Mine 
PMR-2A  Antipersonnel  Mine 
PROM-1  Antipersonnel  Mine 
TM-500  Antipersonnel  Mine 
MT-4  Antipersonnel  Mine 
PMR-3  Antipersonnel  Mine 
TMA-1  Antitank  Mine 
TMD-2  Antitank  Mine 
PMR-2AS  Antipersonnel  Mine 
PSM-1  Antipersonnel  Mine 
MC-71  Antitank  Mine 
TMM-1  Antitank  Mine 
Type  69  Antitank  Mine 
PMD-1  Antipersonnel  Mine 


0  0.50 


0  0.50 


0.50  0.10 
0.50  0.10 
0.50  0.10 
0.50  0.10 
0.50  0.50 
0.50  0.10 
0.50  0.10 
0.50  0.10 
0.50  0.10 
0.50  0.50 
0.50  0.50 
0.50  0.50 
0.50  0.50 
0.50  0.50 
0.50  0.10 
0.50  0.10 
0.10  0.05 
0.50  0.10 
0.50  0.10 
0.50  0.10 
0.50  0.10 
0.50  0.10 
0.50  0.50 
0.50  0.50 
0.50  0.10 
0.50  0.10 
0.50  0.10 
0.50  0.50 
0.50  0.10 
0.10  0.05 


0.05  0.01 
0.05  0.01 
0.05  0.01 
0.05  0.01 
0.65  0.72 
0.05  0.01 
0.05  0.01 
0.05  0.01 
0.05  0.01 
0.10  0.01 
0.10  0.01 
0.65  0.05 
0.65  0.80 
0.65  0.05 
0.05  0.01 
0.05  0.01 
0.01  0.01 
0.05  0.01 
0.05  0.01 
0.05  0.01 
0.05  0.01 
0.05  0.01 
0.10  0.01 
0.10  0.01 
0.05  0.01 
0.05  0.01 
0.05  0.01 
0.65  0.05 
0.05  0.01 
0.01  0.01 


!«,'  ’k"'  'j 

”o.6i  ao5 
0.01  0.20 
0.01  0.20 
0.01  0.05 
0.99  0.05 
0.01  0.05 
0.01  0.20 
0.01  0.05 
0.01  0.95 
0.01  0.05 
0.01  0.05 
0.01  0.20 
0.05  0.20 
0.01  0.20 
0.01  0.05 
0.01  0.20 
0.01  0.05 
0.01  0.05 
0.01  0.05 
0.01  0.20 
0.01  0.20 
0.01  0.05 
0.01  0.20 
0.01  0.05 
0.01  0.05 
0.01  0.05 
0.01  0.05 
0.01  0.05 
0.01  0.05 
0.01  0.05 


0.35  0.50 
0.50  0.45 
0.50  0.45 
0.35  0.50 
0.35  0.50 
0.35  0.50 
0.50  0.45 
0.35  0.50 
0.50  0.25 
0.35  0.50 
0.35  0.50 
0.50  0.45 
0.50  0.45 
0.50  0.45 
0.35  0.50 
0.50  0.45 
0.35  0.50 
0.35  0.50 
0.35  0.50 
0.50  0.45 
0.50  0.45 
0.35  0.50 
0.50  0.45 
0.35  0.50 
0.35  0.50 
0.35  0.50 
0.35  0.50 
0.35  0.50 
0.35  0.50 
0.35  0.50 


0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.01  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.951 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.951 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
0.50  0.95 
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